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Introduction 



Michael J. Feuer and Richard J. Shavelson 



The American labor market is experiencing a dramatic transition. Between 
1970 and 1993 the proportion of all U.S. workers employed in manufacturing fell 
by 41 percent, from 27 percent of total employed to 16 percent. In one year 
alone, 1992-1993, 40 million new jobs were created in the nonfarm sector, while 
some 238,000 manufacturing jobs were lost. The shift has clearly been in the 
direction of employment that relies on a different mix of skills. For example, as 
reported by the Bureau of Labor Statistics (U.S. Department of Commerce, 1994), 
the fastest-growing occupations include home health aides, physical therapy aides, 
computer engineers, and scientists; the fastest-declining occupations are frame 
wirers, signal or track switch maintainers, and central office operators. 

At the same time, the distribution of earnings among U.S. workers has shifted 
dramatically. On average, male high school graduates aged 25-34 earned 15 
percent less in 1989 than in 1979 (Levy and Murnane, 1992). And the gap 
between the earnings of high school and college graduates grew from 13 to 43 
percent between 1982 and 1992. 

These shifts have contributed to a growing sense of alarm about the capacity 
of the nation’s schools to supply adequately skilled graduates to the work force. 
Indeed, concern with long-term productivity and competitiveness has been a 
principal force behind the wave of education reform efforts that began in the mid- 
1980s. But the role that schools can or should play in preparing people to enter 
the world of work is hotly debated. Business leaders tend to lament the low skill 



This chapter draws on the published conference summary, Transitions in Work and Learning: 
Implications for Assessment (Washington, DC: National Academy Press, 1996). 
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levels of entry-level workers but are often unclear about exactly what skills are 
most important; educators tend to challenge the notion that their principal objec- 
tive should be to supply skilled laborers, even as many of them recognize the 
public’s historical faith in schools as the gateway to good jobs and a high stan- 
dard of living. With nearly constant reminders of the economic revolution affect- 
ing all industrial societies, questions about how to define and measure workplace 
competencies, how to establish skill requirements, and how to create incentives 
for teaching and learning in schools and work establishments have again risen to 
the fore. The central questions are often posed with deceiving simplicity: 

• How is work changing? 

• What skills are required to perform productive work? 

• What methods are needed to provide accurate information about the sup- 
ply of skills and employers’ demands? 

• What are the effects of using tests and other indicators of performance on 
efficient and equitable functioning of labor markets? 

To help nurture the important and ongoing national dialogue on these issues, the 
National Research Council’s Board on Testing and Assessment convened a two-day 
conference in March 1996, at which a group of researchers and policy makers 
engaged in an interdisciplinary review and discussion of available data and implica- 
tions for assessment policy. This activity reflects on one of the board’s principal 
mandates: to foster high-level scientific deliberations on public policy issues that 
involve the design, uses, and effects of testing and assessment technologies. 

The board commissioned a set of papers for the conference that, together, 
offer a uniquely cross-cutting view of the evolving role of assessment in fostering 
both improved learning and clearer signaling of individuals’ skills. The authors 
were asked to draw on their own research expertise and to consider the implica- 
tions of their work for the more general questions surrounding education, train- 
ing, and school-to-work policies. 

The papers in this volume are grouped into five parts, following the format of 
the conference. Part I consists of two papers that raise the fundamental underly- 
ing question: Does empirical evidence support the claim of a skills mismatch in 
the U.S. economy? Expressed differently, are changes in the organization and 
output of work in the U.S. economy creating a demand for skills that are not 
adequately provided by the existing education system? 

In his paper, Harry Holzer reports that economic returns to education have 
risen dramatically in recent years and argues that the supply of skilled workers 
has not kept pace with the shifting labor market demand for higher levels of 
educational attainment. Although this short-run imbalance could theoretically be 
overcome in the long term if employers and workers invest in appropriate educa- 
tion and training, Holzer cautions against overreliance on the market’s capacity 
for self-correction. Among the policies that he urges exploration of are those that 
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can improve the quality and flow of information between the education and work 
sectors, which suggests the need for test-based data that signal the skills that 
young workers should acquire and that provide employers with reliable informa- 
tion about workers’ likely future productivity. 

In Chapter 2, Robert Zemsky offers a different perspective on the skills gap 
hypothesis. He argues that most employers do not believe that schools can fulfill 
their needs, no longer look to the schools as a fertile ground for future employees, 
and would prefer to rely on an older cohort of workers with labor market experi- 
ence. Taking issue with those who point to a lack of communication between 
schools and workplaces as the principal explanation of weaknesses in the Ameri- 
can school-to-work transition system, Zemsky argues that employers are typi- 
cally unable to articulate what skills they need, so that even if better communica- 
tion links were established the content of the communications would still be 
inadequate. In his view, employers resort to a “trial -and-error” hiring strategy, 
reserving the best jobs for those with significant prior experience. Zemsky claims 
this is a contributing factor to the phenomenon of labor market “churning” 
wherein young workers spend many years after formal schooling moving into 
and out of various jobs. 

Part II of the volume moves the discussion from the macroperspective of 
aggregate economic and survey data into a detailed microlevel exploration of the 
changing nature of jobs in specific workplaces. The papers by Bonalyn Nelsen 
and Glynda Hull represent the increasingly important ethnographic perspective 
on labor markets, which adds richness and texture to discussions about the skill 
demands of employers, the organization of education and training, and the pos- 
sible effects of alternative assessment and credentialing strategies. Nelsen re- 
ports on her research on automobile repair technicians and offers evidence that 
on-the-job learning is a necessary step in becoming a top-level repair technician 
and that such learning builds on social skills as well as more traditional academic 
skills. Her paper underscores the importance of including measures of “social 
capital” — skills and knowledge required to evaluate and respond to situational 
demands in social settings — in studies of changing skill demands and the educa- 
tional implications. 

Similarly, Hull focuses on a particular type of workplace — electronics facto- 
ries in Silicon Valley. Her main argument is that literacy skills are critical in the 
definition of high-performance workplaces. For example, reorganization of the 
electronics factory into a high-performance workplace with work teams had an 
enormous effect on the literacy requirements of front-line workers engaging in 
circuit assembly. Especially in multilingual workplaces, Hull argues, “a literate 
identity is an important aspect of a worker’s sense of [self].” Based on her 
ethnographic study, she concludes that requirements for formal, informal, writ- 
ten, and oral communications are changing significantly as companies become 
high-performance work organizations. Her suggestion that workers with limited 
English language skills can develop compensatory mechanisms for effective com- 
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munication with co-workers and supervisors points to the need for careful defini- 
tion of “literacy” in the context of workplace performance and productivity. 

Part III addresses the implications of changing workplaces for the assess- 
ment and measurement of skills. Robert Mislevy’s principal suggestion is that 
assessment tools need to be developed that more accurately reflect real-world 
situations in which learning takes place. Mislevy argues that increasing heteroge- 
neity in the workplace demands that assessment tools provide fair and accurate 
information on a wide range of skills and abilities and that tests alone cannot 
measure abilities independent of cultural and other factors that influence the 
effectiveness of learning environments. 

Kenneth Pearlman concentrates on the manager’s perspective of screening 
and selection decisions and on the importance of “cross-functional skills,” such 
as organizing, planning, decision making, negotiating, and teamwork, in the 
evolving high-performance workplace. Pearlman suggests that assessment and 
learning need to be tightly integrated activities and argues for the creation of 
“programs that integrate, motivate, and reward development of [cross-functional] 
skills in K-12 education.” 

How will changing definitions and requirements of work, coupled with new 
approaches to selection, screening, and assessment, be constrained by the legal 
and social environment? This was the basic question posed in the fourth session 
of the conference, which included papers by Dennis Parker and Neil Schmitt. 
Parker calls attention to the purpose of the School-to-Work Opportunities Act — 
to improve the school-to-work transitions of all students. The goal of greater 
inclusion holds important implications for testing and assessment. On the one 
hand, linking schools and workplaces more tightly suggests a significant role for 
testing as a means of evaluating the extent to which young people have acquired 
the requisite skills; but as Parker notes, schools and school districts must be 
aware of the legal and social issues that surround the use of tests as gatekeepers 
for employment opportunity. 

In his paper, Schmitt discusses the formidable challenge of using valid as- 
sessments to achieve a capable and diverse work force within the constraints of 
the 1991 Civil Rights Act. His paper offers five approaches to meeting the 
challenge: (1) include additional measures of job-related constructs that have 
little or no adverse impact; (2) change the format of questions or the types of 
responses required; (3) use computer or video technology to present test items; 
(4) employ procedures currently used in education, such as portfolios and “au- 
thentic” assessments; and (5) change the way scores are used and interpreted and 
consider the use of “bands” rather than cut scores and rankings. Schmitt is 
guardedly optimistic about the combined effects of these strategies but argues for 
continued exploration of new assessment methods well suited to the changing 
demands of work and learning. 

Part V of this volume offers three overarching perspectives on the evolving 
literature and policy debate over school-to-work transitions and the roles of as- 
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sessment. Larry Cuban urges greater consideration of the historical and political 
contexts of the policy debate. Lauren Resnick advocates the possibility of 
strengthening human intellectual capacity by employing an effort-based school- 
to-work system. Alan Lesgold offers the perspective of a cognitive psychologist 
and provides a provocative set of suggestions stemming from research on the 
types of knowledge necessary and useful in various work contexts. 

Among Cuban’s key suggestions is that the role of teachers be kept in sharp 
focus: to argue that schools must change, he notes, means that teachers must 
“alter [their] behavior in ways to make learning better for students.” But, he 
warns, if one accepts the basic premise that schools are responsible for young 
people’s transitions to work, it follows that those who have caused the existing 
problem (teachers) are also the ones expected to bring about the solution. 

Resnick suggests an alternative effort-based approach to our nation’s present 
system of education and its accompanying modes of entry into the work force, 
which, according to her, is designed around the belief that talent and ability are 
largely inherited and fixed. Resnick posits that it is our current approach to 
educational practice and not our teachers that is the cause of existing problems. 
Implementation of the effort-based system Resnick describes would provide some 
remedy for what she views as a two-tiered education system driven by our per- 
ceptions of students’ talent and ability. 

Lesgold, too, draws attention to the conflicting and potentially incompatible 
demands placed on schools and teachers. He notes, for example, that while 
teamwork and quick thinking are often cited as critical parts of modern work, 
these are not necessarily the kinds of skills and abilities that schools are expected 
to emphasize: indeed, whether teamwork and quick thinking can be made com- 
patible with other goals of education — individual and independent thinking, care- 
ful (often necessarily slow) experimentation with new ideas — raises a serious 
issue, for policy makers aiming for better links between the worlds of formal 
schooling and postsecondary learning and work environments. 

The papers in this volume make a significant contribution to our understand- 
ing of the complex and interlocking issues of changing work, learning, and as- 
sessment. They provide the conceptual frameworks and empirical bases neces- 
sary for inquiry into the pressing issues surrounding transitions into and between 
learning and work environments. The Board on Testing and Assessment plans to 
continue to serve as a focal point for these issues. 

REFERENCES 



U.S. Department of Commerce 

1994 Statistical Abstract of the United States: The National Data Book. Washington, DC: 
U.S. Department of Commerce. 

Levy, F., and R.J. Mumane 

1992 U.S. earnings levels and earnings inequality: A review of recent trends and proposed 
explanations. Journal of Economic Literature 30: 1 333- 1381. 





2 



Is There a Gap Between Employer Skill 
Needs and the Skills of the Work Force? 



Harry J. Holier 



INTRODUCTION 

Discussions in the popular press and in the policy-making community fre- 
quently imply that there is a “skills gap” in the U.S. economy — a gap between the 
skills needed by employers and the skills of workers in the labor force. Because of 
this alleged gap, a wide range of policies involving education and job training are 
frequently advocated by various groups and individuals. But what is the evi- 
dence that such a gap truly exists? And if it does, what skills are in particularly 
short supply in the work force? The latter question has been especially difficult 
to answer, at least partly because of a lack of available quantitative data on 
employers and their needs. 



“SKILLS GAPS” IN THE WORK FORCE: CONCEPTUAL ISSUES 

If a gap truly exists between the skills that employers need and those held by 
the work force, can this be inferred? What would be the likely economic effects of 
such a gap? Why might the choices of employers and employees with respect to 
skill acquisition still result in such a gap? 

Mismatches in the Short and the Long Run 

In recent years there has been much discussion among various social scien- 
tists of a skills mismatch in the work force, with the implication that this helps to 
account for the low employment rates of such groups as inner-city minorities 
(Wilson, 1987; Kasarda, 1995). Indeed, mismatch is another term for what econo- 
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mists have often called structural unemployment, a situation in which jobs are 
actually available but unemployed workers cannot be hired because they lack the 
necessary skills, reside in the wrong area, and the like. (For a very recent descrip- 
tion of “structural unemployment” in an introductory text, see Case and Fair, 
1996.) 

But unemployment is not the only possible result of such a situation. To an 
economist, mismatch suggests a gap between the demand and supply sides of the 
labor market — that is, between employers and prospective employees — terms of 
some particular characteristic. Thus, a skills mismatch might arise because the 
demand for workers with certain skills (such as higher education) has increased 
more rapidly than the supply of such workers. 

Figure 2. 1 A illustrates the results of such a shift in demand from less educated 
workers to more educated ones. As the figure shows, the demand shift should 
result in both lower wages and lower employment among the less educated in the 
short run (and the opposite for the more educated), with the exact effects depend- 
ing on the elasticity of the labor supply — that is, the responsiveness of the supply 
of workers to wage levels. 1 The lower this is the smaller will be the loss of 
employment and the greater the loss of wages for this group. 2 

Thus, widening wage and/or employment gaps between education groups 
could be interpreted as a sign that relative demands have shifted between them 
and that some degree of mismatch exists. Widening gaps in earnings or employ- 
ment between specific demographic groups with more or less education (such as 
blacks and whites) could also result, and, even within a group whose members 
have comparable amounts of education, widening gaps for other dimensions of 
skills (such as those measured by test scores) could also indicate relative shifts in 
labor demand. 

This analysis is strictly short run in nature. The new and higher wage gap 
between education groups would imply a higher return to investment in that 
particular skill, which should lead to greater enrollment in higher education 
(Becker, 1975). In the long run the relative supply of educated workers should 
gradually shift out while the relative supply of less educated workers should 
diminish (Figure 2. IB). This will, in turn, reduce the wage gaps between the two 
groups. 



'This analysis assumes that the market was in equilibrium to begin with and that it will be so 
after the demand shifts occur. If wages are rigid, especially in the downward direction for less 
educated workers, the result would be somewhat less reduction in wages and somewhat more 
loss of employment (and a rise in unemployment) among less educated workers, but the overall 
implications of the analysis still hold. 

2 The elasticity of the labor supply is reflected in the shape of the labor supply curve; the 
steeper the curve, the lower this elasticity is. A low elasticity implies that people will choose to 
work regardless of the wage level, while a higher elasticity implies that people will choose not 
to work at low wage levels. 
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A. Short Run 




Skilled Labor 



Unskilled Labor 




Skilled Labor Unskilled Labor 



S D 

Note: W = wages. iy = labor supply. iy = labor demand. 

FIGURE 2-1 Shifts in demand for skills and supply adjustments in the labor market. 



The adjustment process could continue until the gap in earnings between the 
two groups is restored to its initial level. Alternatively, the initial gap might not 
be reached if (1) the demand for skills continues to increase and to outpace supply 
adjustments or (2) there are barriers or costs that limit the magnitudes of the 
supply adjustments. The second situation might, for instance, occur if too few 
students who graduate from high school have academic backgrounds that are 
strong enough for them to consider enrolling in college. Furthermore, the rising 
costs of attending college, combined with cuts in financial assistance for lower- 
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and middle-income families, could limit enrollments of students from such fami- 
lies (Kane, 1995). 

Other imperfections in capital and labor markets might tend to reinforce 
these factors, leading to investments in higher education that are too small to 
restore earlier differentials between groups. 3 In this case the wage and employ- 
ment effects of mismatch will persist, even in the long run. 

Finally, higher unemployment (as opposed to just lower employment) can 
also result from labor market mismatch. 4 This will occur if (1) there are rigidities 
(such as minimum-wage laws) that keep wages among the less educated from fully 
adjusting to the lower equilibrium levels shown in Figure 2.1 A or (2) the less 
educated prefer to keep searching for better jobs, rather than accepting jobs with 
lower wages. 5 In both cases, one would expect to find the coexistence of (1) 
higher job vacancy rates for at least some firms and (2) higher unemployment 
rates for workers. 6 



Employer Choices: Hiring, Training, and Other Options 

At least in theory, employers’ skill needs are not fixed or absolute, and 
employers have a greater degree of choice over what they need than they might 
acknowledge. In the long run, employers choose among different levels of capital 
and technology that imply varying needs for skilled versus unskilled labor. For 
instance, a decision to replace production workers with some type of capital 



3 These other market imperfections include liquidity constraints on individuals (so that people 
are unable to borrow for college education today against their expected future earnings), 
planning horizons that are too short, and inaccurate expectations of future wages that under- 
state returns to education. Of course, a different set of inaccurate expectations could just as 
easily lead to overinvestment in education (relative to what is “socially optimal”), as could a 
variety of other circumstances in which education merely serves as a sorting or signaling device 
rather than as a productivity-raising investment. For a recent statement of the latter arguments, 
see Weiss (1995). 

4 Lower employment could exist without higher unemployment if those without work with- 
draw from the labor force altogether. The issue of whether the distinction between being in and 
being out of the labor force makes sense for all those without work has been debated by 
economists in recent years (e.g., Clark and Summers, 1982; Flinn and Heckman, 1993). 

5 The issue of whether or not minimum wages contribute to unemployment among low-wage 
workers continues to be debated among economists (e.g.. Card and Krueger, 1994; Neumark 
and Wascher, 1995). If their higher unemployment is due to longer periods of job search, this 
might be attributable to higher reservation (or minimally acceptable) wages among workers 
rather than government barriers in the labor market (e.g., Feldstein and Poterba, 1984). 

6 A skills mismatch would certainly result in high vacancy rates for jobs requiring more 
skills; if less skilled workers then refuse to accept lower-wage jobs, vacancy rates would rise for 
jobs requiring fewer skills as well. While there have been some analyses of job vacancy rates 
over time or across areas and job categories in the United States (e.g., Abraham, 1983; Holzer, 
1989, 1994), such data are not routinely collected by the U.S. government; therefore such 
analyses are quite rare. 
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equipment will change employers’ relative demands across skill categories. 
Workplace organization and job descriptions are clearly malleable over a long- 
term time horizon, and employers frequently make choices about whether or not 
to upgrade hiring requirements along educational or experience dimensions (e.g., 
Levy and Mumane, 1995). 

Even in the short run, with a given set of jobs, employers face a variety of 
choices regarding needed skills. For instance, employers who have difficulty 
filling vacant jobs could attract more (and presumably better-qualified) appli- 
cants by choosing to pay higher wages. 7 Alternatively, firms could invest more in 
recruiting, through advertising or the use of employment agencies (Holzer, 1 987). 

Finally, employers could generate more highly skilled employees by train- 
ing the workers they hire, rather than demanding applicants who have certain 
skills ex ante. Clearly, the strategies of increasing wage levels or recruitment 
might only redistribute a fixed number of skilled workers among employers; the 
strategy of training workers would help to generate a higher overall level of skill 
in the work force. 

Firms can choose how much training to invest in employees on the basis of 
prospective market returns for such training through, for example, higher em- 
ployee productivity. If the skills employers hope to generate are completely 
general — that is, can be used in many types of work settings — they will generally 
choose not to bear the costs of such training since employee turnover may cause 
them to lose their investments. In this case, employers will provide such training 
only if they can transfer the costs to employees (by paying them lower wages) or 
can reduce turnover (through apprenticeships, etc.). As the skills needed become 
more specific to an industry, an occupation, and, especially, an individual firm, 
employers should be more willing to share in these costs (Becker, 1975). 

But a firm’s willingness to make these investments might be limited by a 
variety of market imperfections, such as wage rigidities, financial constraints, and 
short-term planning horizons. 8 Furthermore, the provision of training might actu- 
ally cause employers to raise, rather than lower, their ex ante skill requirements if 
they view certain personal skills as being complements to, rather than substitutes 
for, the ones they hope to provide through training. (See, e.g., Lynch, 1992, and 
Cappelli, 1996, for some mixed evidence on this issue.) 

The training choices of firms might therefore reinforce gaps or mismatches 



7 The notion that it might be cost effective for firms to pay wages above the market level has 
been emphasized in the economics literature on “efficiency wages” (e.g., Katz, 1986) and in the 
human resources literature. But for many firms a low-wage/high-tumover policy might still be 
the most efficient strategy. 

8 For instance, minimum-wage laws may prevent firms from paying lower wages to employ- 
ees while they are training them, which may make firms reluctant to invest in such training at 
all. Liquidity constraints on a firm (from limitations on its ability to borrow) or pressure from 
stockholders to stress short-term profitability rather than long-term growth might similarly 
reduce a firm’s training investments. See Lynch (1993). 
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between their own skill needs and those of less educated workers, instead of 
helping to mitigate those gaps. 

Inferring Applicants’ Skills 

Employers might have a clear sense of what tasks need to be performed on 
their jobs and what skills and personal characteristics are necessary for perform- 
ing those tasks. But those skills are often not directly observable to an employer 
at the time of hiring. In other words, the employer will often not know very much 
about an applicant’s prospective ability to perform well on the job. Therefore, 
employers look for a variety of personal credentials, such as level of education, 
previous job training or work experience, and references. During interviews, they 
also look for a variety of personal characteristics, such as social and verbal skills 
and attitude. Other screens, such as tests (either of cognitive abilities or specific 
job tasks), are sometimes used as well. 

An applicant’s personal characteristics or test results are used as signals or 
predictors of future productivity on the job, rather than considered to be indica- 
tors per se of the skills required for job performance. Of course, the ability of these 
credentials and characteristics to actually predict job performance may be quite 
limited (Bishop, 1993). Employers’ perceptions of some of them, especially 
attitudes, are inherently subjective and could lead to discriminatory hiring out- 
comes as well. Indeed, at least some firms are aware of potential legal constraints 
on their ability to use certain screens that they cannot tie directly to job perfor- 
mance. 9 

More generally, the costs to employers of obtaining various kinds of infor- 
mation (such as school grades, transcripts, and criminal background checks) might 
outweigh the information’s potential usefulness, thereby discouraging employ- 
ers from seeking information that would better enable them to judge worker qual- 
ity. 10 Thus, mismatches between jobs and workers could result from employers’ 
lacking information that would enable them to identify skilled applicants as well 



9 These constraints arise out of the 1971 U.S. Supreme Court decision in Griggs v. Duke 
Power (401 U.S. 424, 19719, which established that hiring procedures that have “disparate 
impacts” on the employment of whites and minorities create a prima facie case for discrimina- 
tion and require the employer to establish some link between these procedures and employee 
performance on the job. These principles were reaffirmed in the Civil Rights Act of 1992. Of 
course, firms differ greatly in the extent to which they think they are subject to such legal 
constraints; for instance, large firms appear much more concerned than smaller firms (Holzer, 
1996). 

,0 Bishop (1989) has argued that employers would use academic grades to evaluate appli- 
cants (and students would have more incentive to perform better in high school) if transcripts 
were more easily attainable from high schools. Bushway (1995) also argues that the costs of 
doing checks on criminal backgrounds dissuade many employers from doing so and may 
actually hurt the wages of young black males, who are often generally suspected of having 
criminal records. 
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as from low overall skill levels among applicants. 1 1 Both of these problems can 
stem from “market failures” in private-sector labor markets, and a variety of policy 
interventions may be appropriate if evidence of these problems is found in labor 
market data. 



GENERAL ECONOMIC EVIDENCE 

The above discussion suggests that, when the demand for certain skills grows 
relative to their supply in the labor market, those skills will generate higher 
returns (at least in the short run). Therefore, one way of making inferences about 
“skill gaps” is to review the general empirical evidence on labor market returns to 
various skills and how they have changed over time. 



Returns to Education 

The simplest and most easily observable measure of labor market skill is the 
number of years of schooling and educational degrees that an individual has 
obtained. On this dimension the evidence is strong and very clear: the returns to 
education have risen quite dramatically in recent years. For instance, in 1979 the 
average weekly earnings for young college graduates were about 45 percent of 
those for high school graduates; by the late 1980s the ratio had risen to about 85 
percent (Katz and Murphy, 1992). 

This rising gap in earnings between more and less educated workers has 
coincided with a dramatic decline in the real hourly earnings of less educated 
males, especially among the young. Thus, the real wages of male high school 
graduates between the ages of 25 and 34 declined by over 20 percent from the late 
1970s to the late 1980s (Katz and Murphy, 1992); the declines for male high 
school dropouts were even larger. In contrast, real wages rose modestly for young 
males with college or higher degrees and rose substantially for college-educated 
young females (Bound and Holzer, 1995). (The gender gap in earnings declined 
at all levels of education during the 1980s, even while inequality was growing 
across other dimensions. See Blau and Kahn, 1994, for explanations of why this 
might have occurred.) 

These changes in relative and real wages across groups parallel the changes 
that have occurred in employment rates (or annual hours worked). Basically, 
employment and labor force participation rates have risen for young females, 
especially the more educated, while they have declined quite substantially for 
male high school dropouts and blacks (Juhn, 1992; Bound and Holzer, 1995). 
The falling employment rates for young and less educated black males have also 



1 1 These microievel mismatches because of poor information could also result in higher 
vacancy rates in skilled job categories or high turnover rates, where the latter occur as employ- 
ers (or employees) realize they made “errors” in the hiring process. 
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coincided with a rapid rise in criminal activity and incarceration rates for them, 
especially relating to the drug trade (Freeman, 1994; Piehl, 1995). 

Overall, this pattern of falling employment and wages for the less educated 
and rising employment and wages for the more educated strongly suggests that 
employers’ demands have shifted toward workers with higher education more 
rapidly than the relative supplies of the two groups have been able to adjust. 
Indeed, relative increases in the supply of college graduates actually slowed 
during the late 1970s and early 1980s, reflecting an earlier drop in college enroll- 
ment rates as well as the declining number of young people in the “baby bust” 
cohort. These enrollment drops appear to have contributed to the market premi- 
ums that college graduates have enjoyed (Katz and Murphy, 1 992). More recent 
evidence suggests that enrollment rates have recovered somewhat since then (in 
response to the rising returns for education) and are likely to continue to rise 
(Mincer, 1994). But few observers expect these increases to be sufficient to fully 
reverse the recent increases in earnings gaps between education groups, espe- 
cially since the relative demand for college-educated workers will continue to 
grow (Bishop, 1995). 

Why does the demand for workers with higher education continue to rise? 
Growing international competition and the exodus of manufacturing plants from 
the United States to lower-wage areas are frequently mentioned as major reasons 
for these changes. But these labor market changes have occurred in nonmanu- 
facturing (or nontraded goods and services) as well as manufacturing industries; 
even among the latter, most of the changes have occurred within particularized 
manufacturing industries rather than between industries whose relative employ- 
ment levels are affected by trade (Berman et al., 1994; Freeman, 1995a). 

The most likely suspect for this shift in employer demand is a rapid increase 
in the pace at which employers have implemented various technological 
changes. Computer-related technologies (such as CAD-CAM and robotics) have 
clearly transformed many manufacturing processes. At the individual level, 
computer use is clearly correlated with higher educational attainment or wage 
levels among workers (Krueger, 1993), and at the industry level, industries in 
which technological changes have been most rapid have also experienced the 
largest declines in employment among less educated production workers (Ber- 
man et al., 1994). 

Of course, technological change need not always be “biased” toward more 
highly educated workers (Goldin and Katz, 1995), and examples can certainly be 
found of computers leading to lower rather than higher skill requirements for 
workers. But, on average, rising capital intensity and technological improvement 
seem more likely to be associated with higher demand for educated labor in the 
United States (Bartel and Lichtenberg, 1987; Hamermesh, 1993). Changes in the 
organization of production that at least some firms have chosen to undertake, 
such as total quality management and other “high-performance” workplace ac- 
tivities, might also increase employers’ demand for education (e.g., Ichniowski et 
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al., 1995; Cappelli, 1995b, 1996). A variety of industry case studies seem to 
corroborate that this occurs with technological change and/or workplace reorga- 
nization (e.g., Bureau of Labor Statistics, 1984, 1986; Bailey, 1990; Levy and 
Mumane, 1995). 

Thus, the data strongly suggest that employer demand for more educated 
workers has risen relative to their supplies in recent years. The case for a skills 
gap or mismatch in education levels can therefore be made. This is true even 
though overall unemployment levels in the United States are not high, espe- 
cially relative to European countries. Apparently, the relative demand shifts in 
this country have largely resulted in low wages for the less educated (except 
among high school dropouts and young blacks, as noted above), while in Europe 
they have mostly resulted in lower employment rates (e.g., Freeman and Katz, 
1994). 12 

Finally, there appears to have been no strong trend toward greater or lesser 
overall job stability in recent years, as measured by turnover rates or job tenure 
(i.e., time with a single employer). However, average tenure has declined some- 
what among the lowest-wage employees. Whatever the causes of these trends, 
they certainly do not imply a greater willingness among employers to invest in 
job training for their low-tenure employees. 13 

A variety of caveats might be mentioned here. For one thing, although not all 
young college graduates will easily find employment, especially at relatively 
high wages (Hecker, 1992), they are, on average, a good deal more likely to do so 
than are those without college degrees, and the gaps between the abilities of these 
two groups to do so have certainly risen in the past 10 to 15 years (Bishop, 1995; 
Murnane, 1995). Furthermore, the rising relative demand for college-educated 
workers is not the only reason for the declining wages of the less educated. Fall- 
ing rates of union membership, falling real minimum wage levels, and rising 
immigration all appear to have contributed to this development (e.g., Freeman, 
1995c; Dinardo et al., 1995; Jaeger, 1995). Furthermore, the rise in labor market 
inequality has occurred even within education groups as well as within every 
other observable demographic category, and these increases remain not well un- 
derstood (Levy and Murnane, 1992). 

Finally, the falling wages of less educated workers in the United States reflect 



,2 On the other hand, Freeman (1995b) notes that if employment and unemployment rates in 
the United States for the least educated males are adjusted so that those incarcerated are included 
among the nonemployed, U.S. employment numbers become much more comparable to those 
of Europe. 

13 See, for instance, Swinnerton and Wial (1995, 1996), Diebold et al. (1996), and Farber 
(1994). The wave of firm restructuring in the early to mid-1990s may not yet be reflected in 
these data, though there has been some recent evidence of stagnating earnings among older 
college-educated males who may be experiencing declines in job tenure (Mumane, 1995). The 
apparent inconsistency between the rising skill and training needs of employers and their 
possibly declining commitment to long-tenure jobs is stressed by Cappelli (1996). 
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the recent decline in overall earnings and productivity growth as well as a widen- 
ing of wage inequality — that is, a stagnating mean (or median) level of earnings 
along with growing variance around that mean. The explanations for this overall 
stagnation are not widely understood, nor is there much consensus regarding 
future trends in this area. (For a very readable summary of trends and the histori- 
cal perspective on this question, see Madrick, 1995.) 

Despite these questions and caveats, the evidence strongly suggests that a 
rise in the demand for educated workers relative to their supply has widened the 
gaps in relative earnings and employment rates between more and less educated 
workers, consistent with a “skills gap.” 

Test Scores 

The fact that earnings inequality has risen even within educational categories 
raises the question of whether employer demand for skills measured along other 
dimensions has risen as well (e.g., Juhn et al., 1993). 

One measure of individual abilities that varies within educational categories 
can be found in scores on tests of cognitive ability. A long and sometimes contro- 
versial literature has appeared over several decades on the extent to which test 
scores actually measure cognitive abilities, on their environmental versus heredi- 
tary determinants, and on their correlations with earnings (e.g., Jencks, 1972; 
Herrnstein and Murray, 1994; Goldberger and Manski, 1995; Hauser and Carter, 
1995). But some important new evidence on the labor market effects of test scores 
has emerged in the past few years. For one thing, Murnane et al. (1995) have 
found that the returns to test scores (especially for math) rose significantly during 
the 1980s. Indeed, they found that the entire increase in returns to college educa- 
tion for females can be accounted for by the increased return to test scores during 
that period. Murnane et al. also found that wage returns to test scores rose with the 
number of years of labor market experience. This reflects the fact that test scores 
(and cognitive abilities more generally) are not observable by employers at the 
time of hiring. But the rising returns to these scores with experience indicate that 
they may well be correlated with subsequent labor market performance, which 
employers can more easily observe over time. 14 

Other studies (e.g., O’Neill, 1990; Ferguson, 1993; Neal and Johnson, 1995) 
have also found that differences in hourly earnings between whites and blacks 
(after educational differences have been controlled for) can be accounted for 
largely by differences in the scores of the two groups on armed forces qualifying 
tests. Effects of test scores on the relative employment rates of whites and blacks 
have also been found (e.g., Rivera-Batiz, 1992), though a substantial racial differ- 



,4 Hunt (1995) reviews the psychometric literature on the measurement of IQ and its links to 
actual work performance. Bishop (1989, 1995) provides some economic evidence that links 
test scores to work performance on a variety of tasks as well as earnings. 
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ence remains here even after these differences are controlled for. While the test 
scores of blacks have risen in recent years relative to those of whites (Grissmer et 
al., 1994), the economic returns to test scores appear to have risen even more 
rapidly, thus preventing any relative improvement in black-white wage rates 
(Bound and Freeman, 1992). 

A similar story can be told about overall test scores in the population: they 
rebounded somewhat from their lows in the 1970s (Bishop, 1992), especially 
among the lowest-scoring groups. But this did not occur rapidly enough to offset 
the rising returns and resulting increases in inequality associated with these dif- 
ferences. Summary data on the National Assessment of Educational Progress test 
scores still indicate large fractions of the population scoring at very low levels of 
reading or mathematical competence (Barton and Kirsch, 1 990). The lower means 
and higher variances in test scores among less educated workers in the United 
States than in several other industrial countries have also been linked to the 
greater relative declines in earnings that have occurred here in recent years 
(Bishop, 1989; Nickell, 1997) as U.S. workers have appeared to have more diffi- 
culty adjusting to recent shifts in labor demands. 

A few caveats are in order here. The magnitudes of estimated relationships 
between test scores and earnings or job performance are not enormous — test scores 
generally account for little more than 10 to 20 percent of the variance in earnings 
or job performance (Bishop, 1995; Hunt, 1995). Some questions remain as to 
what the scores really measure and whether their correlations with measured job 
performance are real or spurious. For blacks these questions are even greater than 
for whites. 15 

Nevertheless, employer demand for cognitive abilities seems to be growing 
even within educational categories and is apparently growing more quickly than 
the supply of these skills can respond. Thus, the economic returns to these abili- 
ties appear to be rising as well. 



EMPLOYERS’ SKILL DEMANDS: SURVEY EVIDENCE 
The Multi-City Employer Survey 

While the evidence cited above clearly indicates that relative employer 
demand has shifted to workers with more education and better cognitive abili- 
ties, many questions remain unanswered. Exactly what skills do employers 
currently need among their less educated (i.e., noncollege) workers? How do 
employers seek these skills — that is, how do they screen for them, and what 
observable credentials and characteristics do they regard as signals of potential 



15 Hunt (1995) notes that test scores generally have even less predictive power with regard to 
job performance for blacks than for whites, while Rodgers and Spriggs (1995) argue that test 
scores are rewarded quite differently in the labor market for blacks than they are for whites. 
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ability? What are the consequences for workers who cannot provide these 
signals? 

To help provide answers to these questions, I recently administered a new 
survey to some 3,200 employers in four large metropolitan areas: Atlanta, Boston, 
Detroit, and Los Angeles. (This survey is part of a larger Multi-City Study of 
Urban Inequality [MCSUI], funded by the Ford and Russell Sage foundations in 
these four metropolitan areas.) The survey was administered over the phone 
between June 1992 and May 1994 to individuals in the establishments who were 
identified as being responsible for the hiring of noncollege workers in general or 
workers in specific occupations. The sampling process used here generated a 
stratified random sample of employers who are distributed across establishment 
size categories in roughly the same proportions as the overall labor force. 16 Be- 
cause of this sampling property, the characteristics of a sample of newly filled 
jobs at these firms can be considered, which should fairly well represent the jobs 
that are now being filled by employers and which new job seekers will currently 
face in the labor market. 

Survey respondents were asked a variety of questions about all currently 
filled or vacant jobs at the firm as well as the last job that they filled and the last 
worker hired into this job, including the skills needed, recruitment and screening 
methods used, and demographic characteristics of hired workers. Data regarding 
the latter are analyzed below. 17 

Table 2-1 presents data on the cognitive and social tasks that need to be 
performed daily on these jobs and the personal skill credentials required of people 
who are hired. The tasks are measured as responses to questions of how frequently 
each task in the list had to be performed (i.e., daily, at least once a week, once a 
month, or never). The credentials are based on a question of whether or not each 
is “absolutely necessary,” “strongly preferred,” etc. (The credentials are counted 
as “required” if they are listed as “absolutely necessary” or “strongly preferred.”) 
These results are presented for all jobs together and separately for jobs that do and 



1 ^Roughly 30 percent of respondents were drawn from the names of employers generated 
by respondents to the MCSUI household surveys in these four areas; by definition, the em- 
ployers in this part of the sample are weighted in proportion to where people actually work. 
The remainder of the sample was drawn from lists of employers generated by Survey Sam- 
pling, Inc. These lists were random samples within employer size categories, drawn to ap- 
proximate the distribution of workers across these categories in the work force. The overall 
response rate among firms that passed the screening was 67 percent. The analysis of response 
rates across size categories shows little evidence of selection bias along these dimensions, 
thus suggesting that the ex ante sampling criteria are largely reflected in the data. See Holzer 
(1996). 

l^An employee-weighted sample of the most recently filled job at each firm will, over a reason- 
able period of time, also include those that were vacant for a lengthy time period. The sample will 
underrepresent new hires at high-tumover firms, though they will accurately measure the number of 
actual jobs that are filled by these many new hires. New hires at firms experiencing net employment 
growth will also be underrepresented here. 
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TABLE 2-1 Skills and Credentials Required for New Jobs (percentage) 





All 

Jobs 


College 

Required 


No Colleg 

White- 

Collar 


e Required 
Blue-Collar/ 
Service 


Daily task performance 


Customer contact 


73% 


82% 


82% 


51% 


Reading or writing paragraphs 


68 


91 


67 


51 


Arithmetic 


68 


77 


70 


56 


Computer 


56 


74 


70 


20 


Required credentials 


High school diploma 


78 


100 


82 


54 


GED accepted 


— 





66 


44 


GED not accepted 


— 


— 


16 


10 


General work experience 


70 


75 


72 


62 


Specific work experience 


64 


74 


64 


56 


Previous training or certification 


43 


56 


39 


37 



NOTE: All results are sample weighted. 



do not require college degrees. The latter category is also divided by occupa- 
tional category: white-collar versus blue-collar and service jobs. 18 

The results show that credentials requirements and task performance on newly 
filled jobs are extensive. Almost three-fourths of these jobs involve daily cus- 
tomer contact (either in person or on the phone); over two-thirds require daily 
reading or writing of paragraph-length material and the use of arithmetic; and 
well over half involve the use of computers. 19 Furthermore, almost two-thirds 
require not only general work experience but also specific experience related to 
the particular type of work, and over 40 percent require some type of certification 
of previous training. 

These requirements vary with the educational requirements of the job and by 
occupation. Thus, jobs that require a college education generally require a higher 
degree of daily task performance and more experience or training than jobs that 
do not require college; among the latter, white-collar jobs require more than blue- 
collar and service jobs. But even for blue-collar and service jobs, requirements 
are quite extensive. Over half of these jobs require daily customer contact, read- 
ing and writing, arithmetic, general work experience, or specific work experience. 
Indeed, only about 5 percent of all jobs in central-city areas require none of these 
tasks, and the percentage requiring none of these credentials is the same (Holzer, 

18 J°bs are categorized as white collar if they are professional, managerial, technical, clerical, 
or sales jobs. Blue-collar jobs include the skilled crafts as well as machine operators and 
laborers. The service jobs include such categories as food service (i.e., waiters, waitresses), 
cleaning occupations (e.g., janitors), and various nontechnical health aides (such as orderlies or 
nurses’ assistants). 

^ 9 There were separate questions in the survey on reading and writing of paragraph-length 
material. Jobs requiring writing almost always require reading as well, though the converse is 
not true. 
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1996). Comparable statistics for suburban areas are just a few percentage points 
higher. 

Of course, some questions remain about whether or not the requirements are 
hard and fast — in other words, whether employers really do as they say. But no 
such questions even seem relevant for the task performance data, which report 
current employee activities, and the responses to questions on hiring require- 
ments are largely confirmed by information, where it is available, on the charac- 
teristics of the workers actually hired for these jobs. 20 

Thus, these data cast considerable doubt on whether there are enough jobs 
available with very low skill requirements to absorb all potential workers with 
very low skills, especially if welfare recipients are soon required to seek work in 
large numbers (Holzer, 1996). 21 

As argued above, the tasks represent some of the actual skills needed for job 
performance, while the credentials are signals of a candidate’s potential ability to 
perform a job. But employers appear to use a wide range of other screens as well to 
gauge these signals, and they also use a variety of attitudes about various personal 
characteristics in making their hiring decisions. 

Table 2-2 provides data on these other screens and attitudes. It shows that 
written applications, personal interviews, and requests for references are almost 
universally used, even though there are some major doubts about their predictive 
power or objectivity (Karren, 1980). Nonphysical tests are now used in 29 percent 
of all cases, and work samples are reviewed in 21 percent; over 40 percent use at 
least one or the other. 22 On the other hand, checks on educational or criminal 
backgrounds are made less than one-third of the time. 

The data presented here on employer attitudes toward various personal charac- 
teristics are striking. For noncollege positions (the only ones for which these ques- 
tions were asked), employers would not hire people who had been unemployed for 
over a year in about 30 percent of the cases; they would not hire anyone with only 
short-term or part-time work experience in about 50 percent of the cases; and they 
would not hire anyone with a criminal record almost 70 percent of the time. 

The aversion of employers to hiring those with spotty work histories has 
been noted by Ballen and Freeman (1986), who argue that previous employment 



20 For instance, the fraction of workers hired with educational attainments less than the stated 
requirements was very small (i.e., under 10 percent). Of course, the tendency of firms to hire 
such workers should vary with the degree of tightness in the labor market and the nature of the 
skill or credential in question. 

21 This potential imbalance is suggested by the fact that over half of long-term welfare recipients 
(who are those most likely to be affected by time limits or other work requirements) are high school 
dropouts; most can report no recent work experience, and most score in the bottom quintile of the 
population in tests for cognitive ability (Burtless, 1995). These women also constitute roughly 10 to 
15 percent of the household heads in major central cities, and most will probably seek employment in 
central-city areas (owing to transportation or informational limitations). 

22 Roughly one-fifth of the jobs that require either a test or a work sample require both, though 
there is some possibility that these categories are picking up the same activity. 
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TABLE 2-2 Other Screens and Employer Attitudes for New Jobs 
(percentage) 





All 

Jobs 


College 

Required 


No Colleg 
White- 
Collar 


e Required 
Blue-Collar/ 
Service 


Other screens: 

Written application 


82% 


86% 


83% 


80% 


Interview 


88 


91 


89 


85 


References 


76 


86 


75 


69 


Test (not physical) 


29 


25 


34 


25 


Work sample 


21 


29 


16 


21 


Education check 


30 


42 


30 


23 


Criminal record check 


32 


34 


33 


29 


Would hire applicant with 
Unemployment for entire past 
year 






70 


72 


Short-term or part-time 
work experience only 






50 


49 


Criminal record 


— 


— 


31 


34 



instability sends a very negative signal to employers. Evidence on the possible 
“scarring” effects of early unemployment more generally is mixed and is consis- 
tent with the smaller negative effects this trait has on hiring. (See Ellwood, 1982, 
and Meyer and Wise, 1982, for earlier analyses of this issue and Rich, 1994, for 
a more recent analysis.) 

The large fraction of employers who will not hire people with criminal 
records stands in sharp contrast to the much smaller fraction who actually check 
criminal records. As noted above, the costs of checking criminal records are 
quite high in many places, and therefore many employers forgo this information. 
Unfortunately, some probably infer such activity from the race, age, and gender 
of job applicants; and, given the high rates of crime among less-educated and 
unemployed black males, many employers will likely be especially suspicious of 
young black males who lack employment for significant periods of time 
(Bush way, 1995). Thus, developing more effective ways of signaling one’s work- 
related experiences could be especially important for youth in these situations. 

Table 2-3 provides information on how many of these firms have actually 
experienced rising skill needs in the past 5 to 10 years and which skill needs have 
risen. The data indicate that 42 percent of establishments report rising skill 
needs, with somewhat higher rates in the jobs requiring college and somewhat 
lower ones in blue-collar and service jobs. These data may well understate the 
extent that skill needs have increased in this period. 23 



23 The data do not include establishments and firms that went out of business during this period or 
those that began operation very recently. These omissions probably bias the results on skill changes 
downward. 
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TABLE 2-3 Increases in Skills Needed for New Jobs in Past 5 to 10 Years 

(p ercentage 

No College Required 





All 

Jobs 


College 

Required 


White- 

Collar 


Blue-Collar/ 

Service 


Skill needs higher 


Yes 


42% 


50% 


43% 


32% 


No 


58 


50 


57 


68 


Of those with increases, 
primarily which skills? 


Read/write/arithmetic 


33 


26 


33 


42 


Social/verbal 


36 


44 


34 


30 


Computer 


31 


30 


33 


28 



The data also indicate that the demands for basic numeracy /literacy, social/ 
verbal, and computer skills have risen more or less equally, even across educa- 
tional and occupational categories. Interestingly, the rising need for basic skills 
has been highest among noncollege blue-collar and service jobs, where they have 
always been in relatively less demand; this confirms the earlier finding that even 
within these categories fewer jobs are available that do not involve substantial 
need for basic cognitive functions. On the other hand, the need for social and 
verbal skills has risen the most for jobs requiring a college education. 

Do any of these skill needs and employer attitudes affect who actually gets 
hired, especially once obvious characteristics such as educational attainment are 
controlled for? Table 2-4 presents data that speak to this issue. Percentages are 
given for newly hired workers in these jobs who are either black or Hispanic. This 
is done for all job categories as well as for subsets of jobs in which each cognitive 
or social task or each credential is either required or not required. 

The results clearly indicate that blacks and Hispanics are hired less frequently 
for jobs for which any of these tasks or credentials is required. In percentage 
terms the differences are not small. For example, the gap of 1 2 percentage points 
between those hired into jobs that require computer use and those hired into jobs 
that do not constitutes a difference of 32 percent (with the second group used as 
the base). 

In separating blacks and Hispanics, some interesting differences emerge. 
Basically, Hispanics are more disadvantaged by requirements for high school 
diplomas and direct customer contact, while blacks are more disadvantaged by 
previous experience and training requirements (Holzer, 1996). 24 

Separating by gender also indicates that black and Hispanic males are the 



24 Since Hispanics are less likely to graduate from high school than blacks (see, e.g., Hauser and 
Phang, 1993), they are relatively more disadvantaged in jobs for which a high school diploma is 
required. But blacks seem to have more difficulty obtaining the necessary work experience or train- 
ing in the market to make jobs with these requirements attainable. 
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TABLE 2-4 Blacks and Hispanics Hired Into New Jobs by Skills and 
Credentials Required (percentage) 





All 

Jobs 


College 

Required 


No Colleg 

White- 

Collar 


e Required 

Blue-Collar/ 

Service 


All jobs 


31% 


20% 


28% 


44% 


Jobs requiring daily 
performance of 


Customer contact 


29 


24 


27 


41 


Reading or writing 


28 


19 


25 


45 


Arithmetic 


25 


16 


24 


39 


Computer 


26 


22 


26 


42 


Jobs requiring credentials 


High school diploma 


27 


20 


26 


39 


GED 


— 


— 


26 


39 


No GED 


— 


— 


24 


38 


General work experience 


29 


21 


24 


44 


Specific work experience 


28 


18 


25 


44 


Previous training 


29 


23 


24 


42 


Jobs not requiring daily 
performance of 


Customer contact 


36 





34 


48 


Reading/writing 


38 


22 


35 


44 


Arithmetic 


43 


31 


39 


52 


Computers 


38 


09 


35 


45 


Jobs not requiring credentials 


High school diploma 


47 


— 


41 


51 


GED 


— 


— 


42 


55 


No GED 


— 


— 


35 


38 


General work experience 


38 


14 


39 


45 


Specific work experience 


37 


24 


35 


46 


Previous training 


33 


17 


31 


46 



groups most limited by these requirements. In fact, the rising skill needs of 
employers might well account for most or all of the relative deterioration in 
wages as well as employment that these groups have experienced in the past 10 to 
20 years (Holzer, 1 996). 

Of course, these results do not prove that the real skills gap between whites 
and minorities drives the observed employer behavior; instead, discriminatory 
perceptions of ability could result in these outcomes as well. But given the gaps 
that have been documented between average black and white education and 
experience levels, test scores, and so forth, it seems likely that at least part of the 
observed results are based on real differences in average skills. 25 



2S 

For educational attainment the tendency of a hired worker to not meet the stated require- 
ment was actually higher among blacks and Hispanics than whites, especially at firms practicing 
affirmative action in hiring. 
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Other Recent Survey Evidence 

In addition to the employer survey in the MCSUI project reviewed above, a 
number of other surveys of employers have been administered in the past 5 to 10 
years that focus on many of these issues. (Descriptive and qualitative data on 
employers’skill needs can be found in the report of the Secretary’s Commission 
on Achieving Necessary Skills [SCANS], as described in Packer and Wirt, 1992, 
and also in Carnevale et al., 1990.) Among the best known of these are (1) a 
survey of over 3,000 employers in 1994 designed by the National Center on the 
Educational Quality of the Workforce (EQW), administered by the U.S. Bureau of 
the Census and funded by the U.S. Department of Education; (2) a mail survey of 
over 2,500 employers administered by the National Federation of Independent 
Businesses in 1987; and (3) local surveys administered in New York City in late 
1993 by the city’s Department of Employment and in Milwaukee in October 
1993 and 1994 by the Employment and Training Institute of the University of 
Wisconsin-Milwaukee. Other surveys of employers include an update of the 
Employment Opportunity Pilot Project of firms by Barron et al. (1994) and a 
variety of surveys discussed by Kling (1995). The focus here is on those that deal 
primarily with hiring requirements and methods. 

Also, some much more qualitative and in-depth surveys of smaller samples of 
employers have been administered in Chicago, Detroit, Atlanta, and Los Angeles 
(Kirschenman and Neckerman, 1991; Moss and Tilly, 1995; Kirschenman et al., 
1995). These surveys generally provide little quantitative information but gener- 
ate interesting descriptive material that would be hard to generate in the less 
personal formats (i.e., phone and mail surveys) used in the large-sample studies. 

Among the many issues that have been addressed in these surveys (and in 
reports based on them) are (1) the frequency with which certain skills and personal 
characteristics are considered important by employers for job performance, (2) the 
weights placed by employers on a variety of screens and hiring requirements as well 
as their perceptions of applicants they hire, (3) more objective measures of how these 
skills and screens contribute to worker or firm performance, (4) the extent to which 
various skill needs are rising, and (5) the ability of employers to hire employees with 
the relevant skills. Of course, the responses to at least some of these questions will be 
subjective and hard to interpret clearly. But they still provide some interesting 
descriptive data on how employers view their skill needs and hiring. 

Employers consistently report that basic literacy and numeracy skills are 
very important for virtually all jobs. In the New York City survey these skills are 
heavily weighted in every job category, though again somewhat less in the blue- 
collar and service jobs than in the white-collar ones. 26 Listening and speaking 



^ 6 On a scale of 0 to 100 for measuring the “importance” of each skill, reading and writing and 
math skills were ranked 92 to 99 for managerial jobs, 89 to 99 for professional jobs, 77 to 86 for 
technical and skilled jobs, 81 to 97 for clerical and sales jobs, 55 to 81 for service jobs, and 50 to 
79 for semiskilled and unskilled (blue-collar) jobs. See New York City Department of Employ- 
ment (1995). The survey gauged the importance of the lists of skills used in the SCANS report. 

0 
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skills are also considered important in white-collar and service jobs but less so in 
blue-collar jobs. 

A variety of personal qualities, such as responsibility, integrity, and self- 
management, are considered almost as important as the basic skills described 
above, and in blue-collar and service jobs they are even more important. 27 These 
results are consistent with those of Moss and Tilly (1995), who stress the impor- 
tance of what they refer to as “soft skills” — that is, communication skills and 
attitudes/motivation. (See also Cappelli, 1995a.) In addition, the New York City 
survey found that thinking skills, such as decision making, reasoning, problem 
solving, interpersonal skills, and working with technology are all relatively im- 
portant in white-collar jobs and (in some cases) in service jobs as well. 28 

These results are consistent with the notion that growing numbers of compa- 
nies are reorganizing jobs and work in ways that require more problem-solving 
ability on the part of employees, though this is not true universally. For instance, 
in the EQW survey 37 percent of establishments use some type of total quality 
management, which usually requires workers to have a higher degree of analyti- 
cal ability; fewer establishments use a variety of other high-performance organi- 
zational strategies, such as teams (used by just 12 percent). (See National Center 
on the Educational Quality of the Workforce, 1995.) 

As for screens and hiring requirements, both the New York City and the EQW 
surveys found that employers rank attitudes and communication skills as the 
most important characteristics they look for when screening candidates. Inter- 
views are also given a lot of weight, despite the findings (noted above) from the 
human resources literature that question the objectivity and predictive power of 
information gained in interviews. 29 Somewhat more objective measures of skill, 
such as previous experience and work history, are given almost as much weight in 
these studies as the attitude and communication measures. References and rec- 
ommendations score highly as well, as do industry-based credentials in the EQW 
and previous training for some occupations in the New York City survey. 30 

The evidence on measures of academic background is somewhat more mixed. 
On the one hand, educational requirements do exist on most jobs. For instance, 



27 The mean scores for personal qualities were 84 for service workers and 82 for blue-collar 
workers, compared with 79 and 68, respectively, on all basic skill categories. Personal qualities 
had mean rankings of 74 to 93 in the various white-collar occupations, whereas basic skills 
averaged 81 to 96. 

28 The “thinking skills,” which cover a broad range of skills, have mean scores of 87 and 91 
in the managerial and professional categories, 72 in the technical jobs, 73 in sales and clerical 
jobs, 67 in the service occupations, and 62 in blue-collar jobs. 

29 Moss and Tilly (1995) quote a few employers who claim that they just try to get a “feel” for 
the candidate in interviews and put a lot of weight on this subjective impression. 

30 For instance, the mean scores on these responses in the EQW survey (on a scale of 1 to 5) 
are as follows: attitude, 4.6; communication skills, 4.2; previous work experience, 4.0; recom- 
mendations from current or previous employers, 3.4; and industry-based credentials, 3.2. See 
Black and Lynch (1995). 
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the Milwaukee survey shows that only 23 percent of full-time jobs do not require 
high school or more education, as well as training and/or experience. 31 On the 
other hand, in both the New York City and the EQW surveys, years of schooling 
gets only a moderate weight in subjective rankings of importance in all except 
professional and managerial jobs (where college is required). In the EQW survey, 
academic performance is given even less weight than the number of years of 
schooling. 32 

But these results must be interpreted with some caution. For one thing, the 
vast majority of job applicants today have at least a high school diploma; there- 
fore, this credential alone signals little about potential ability to an employer. On 
the other hand, failure to hold a diploma sends a much more negative signal to 
employers, which may be only partly offset by a GED (Cameron and Heckman, 
1993). Thus, a high school diploma is necessary but not sufficient as a signal of 
academic quality. Furthermore, most employers do not use transcripts or other 
indicators of academic performance since they are so hard to obtain (Bishop, 
1989); in other words, it is because of the high cost of using them, rather than their 
low benefit, that employers generally do not weight this information highly. 

The relative importance of education levels and academic performance to 
job outcomes has been established in a few statistical studies of these relation- 
ships. For instance, Black and Lynch (1995) have shown that the average educa- 
tional attainment of employees contributes positively and significantly to the 
value of output at the establishment level, as does the use of academic grades in 
hiring in nonmanufacturing establishments. Bishop (1993), in analyzing the 
National Federation of Independent Businesses data, also found that employer 
perceptions of academic skills contribute somewhat to their evaluations of worker 
performance. Bishop found that occupational skills, the ability to learn new 
things, and leadership also contribute to worker performance in most occupa- 
tional categories and that basic work habits contribute significantly in the blue- 
collar categories. 

Some consensus is found across these studies in terms of the growth of skill 
needs. The EQW survey reports growing needs for skills in 56 percent of estab- 
lishments, which seems relatively consistent with findings in the New York City 
survey and the Moss-Tilly interviews. The area of highest growth in the need for 
skills is in computers, especially in white-collar jobs; 30 to 50 percent of these 



3, These data suggest a somewhat greater availability of jobs with no requirements than did 
the numbers from my own survey mentioned above. This might partly reflect a longer set of 
requirements listed in my questions and Milwaukee’s very tight labor market (in which em- 
ployers are likely to loosen some requirements in order to be able to attract workers). 

32 In the New York City survey, the receipt of a high school diploma or equivalent is given 
a score of only 37 in semiskilled or unskilled blue-collar jobs and 52 in service jobs, whereas 
attitudes and work habits score 90 and above. In the EQW survey, years of schooling com- 
pleted is ranked 2.9, academic performance 2.5, reputation of school 2.4, and teacher recom- 
mendations 2.1. See Black and Lynch (1995). 
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jobs in the New York City survey show growing computer needs, with somewhat 
smaller rates of growth in the other job categories and other skill areas. 

Finally, employers report difficulty in obtaining employees with the neces- 
sary skills for a variety of reasons. For instance, the Milwaukee survey (especially 
in 1994) was administered during a very tight labor market (with local unemploy- 
ment of just 4.0 percent). Thus, roughly 60 percent of employers report some 
difficulty in filling jobs and give somewhat higher rates for jobs that have lower 
educational or experience requirements. But in other surveys employers gener- 
ally report that it is the relative quality of applicants, rather than their numbers, 
that generates their hiring difficulties. For instance, roughly 30 percent of appli- 
cants in the New York City survey were judged deficient in a variety of skill 
categories by employers; even among those hired, deficiencies in basic skills 
were reported in 10 percent of the cases and in higher numbers of cases on other 
skill categories. 33 Respondents to the EQW survey report similar numbers. 

Bishop (1993), using the National Federation of Independent Business sur- 
vey, focuses on a somewhat different problem: the inability of employers to gauge 
whether an applicant possesses the necessary skills and personal characteristics 
given the limited information they have at the time of hiring. Bishop reports that 
employers have somewhat greater difficulty in judging such characteristics as the 
ability to learn new skills, work habits and attitudes, and leadership than basic 
skills or previous job skills acquired. He also found consistent evidence of large 
performance “surprises,” measured as the differences between expected perfor- 
mance at the time of hiring and performance measured later. Bishop therefore 
argues for a variety of ways in which matches between jobs and employees might 
be improved through better provision of information to employers. 

CONCLUSION 

The market rates of return for education and test scores have been rising since 
the late 1970s. This is consistent with the idea of a skills gap or mismatch, in the 
sense that the demands for schooling and cognitive abilities in the labor market 
rose more rapidly than did their supplies. Real wages have declined substantially 
for less educated (i.e., noncollege-educated) males, and employment has declined, 
especially among blacks and high school dropouts (who are increasingly substi- 
tuting illegal for legal modes of work). 

My survey data indicate that employer demands for basic cognitive and 
social skills as well as for various credentials (such as high school diplomas, 
specific experience, and previous training) are extensive; indeed, very few new 
jobs are available for workers without these skills and credentials. The skill needs 
of employers are generally rising. Employer attitudes also indicate a great deal of 



33 In the New York City survey, the greatest deficiencies among those hired are reported in 
the areas of thinking skills (39.5 percent) and technological/computer skills (26 to 28 percent) 
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skepticism about workers with unstable employment histories and those sus- 
pected of having criminal records. Many of these hiring requirements and em- 
ployer attitudes seem to limit the employment options available for less educated 
and especially minority workers. 

Other recent employer surveys mostly confirm these findings. While basic 
skills are required by employers in almost all jobs, so are a variety of communica- 
tion skills and personal qualities (such as motivation and good work habits). 
Analytical skills (such as problem-solving abilities) are mostly valued in white- 
collar jobs or in other jobs where firms are using so-called high-performance work 
practices. When hiring, employers heavily weight impressions from their per- 
sonal interviews as well as previous experience, training, and work history. Appli- 
cants’ educational histories (e.g., whether they graduated from high school, what 
grades they achieved) get somewhat less weight in the employers’ mind, though 
clearly not zero, and when educational attainment is considered in hiring, it does 
seem to contribute to worker performance. Some educational attainment is thus 
clearly necessary for workers to be hired and to perform well, even if it is not 
sufficient. Finally, there is some evidence that employers have relatively little 
information that truly enables them to distinguish strong job candidates from 
weak ones (in terms of prospective job performance). 

On-the-job training for employees might be another way for employers to 
meet their skill needs, and evidence from the EQW survey shows a moderate 
increase in the proportion of firms providing such training (National Center on 
the Educational Quality of the Workforce, 1995). But the provision of such 
training is likely to be limited by a variety of market imperfections, and the 
training is unlikely to benefit employees who (owing to the rising skill needs of 
employers) have difficulty being hired in the first place or who are not likely to 
remain with a single employer for very long. 

Overall, then, a labor market is found in which disadvantaged workers (espe- 
cially minorities and high school dropouts) often appear to have difficulty meet- 
ing the basic skill requirements necessary for employment, while high school 
graduates generally gain employment more easily but primarily at low wages. 
Improving the educational levels and cognitive abilities of these groups would 
certainly help to narrow the growing gaps in employment and earnings between 
them and the more skilled workers and might even contribute to improved eco- 
nomic performance and productivity growth for the economy as a whole. (For a 
recent discussion of the relationship between educational attainment and produc- 
tivity growth, see Griliches, 1996.) 

Making information about prospective worker skills more available to em- 
ployers and improving its quality should enable employers to use such informa- 
tion more frequently in their hiring decisions. This, in turn, might improve the 
incentives for academic performance among high school students, an area that 
now appears to be quite weak. With more highly skilled workers and better 
matches between worker skills and job requirements, employers might also be- 
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come more willing to invest in job training and longer-term commitments to their 
employees. 



REFERENCES 



Abraham, Katherine 

1983 Structural-frictional v. demand-deficient unemployment. American Economic Review 
73(4):708-724. 

Bailey, Thomas 

1990 Changes in the Nature and Structure of Work : Implications for Skill Requirements and 
Skill Formation . Berkeley: National Center for Research on Vocational Education, Uni- 
versity of California. 

Ballen, John, and Richard Freeman 

1986 Transitions between employment and nonemployment. Pp. 75-114 in The Black Youth 
Employment Crisis , R. Freeman and H. Holzer, eds. Chicago: University of Chicago 
Press. 

Barron, John, Mark Berger, and Dan Black 

1994 Employer Search, Training, and Vacancy Duration. Mimeo, University of Ken- 
tucky, Lexington. 

Bartel, Ann, and Frank Lichtenberg 

1987 The comparative advantage of educated workers in implementing new technology. Re- 
view of Economics and Statistics 69( 1 ): 1 - 1 1 . 

Barton, Paul, and Irwin Kirsch 

1990 Workplace Competencies : The Need to Improve Literacy and Employment Readiness. 
Washington, DC: Office of Educational Research and Improvement, U.S. Department of 
Education. 

Becker, Gary 

1975 Human Capital. Cambridge, MA: National Bureau of Economic Research. 

Berman, Eli, John Bound, and Zvi Griliches 

1994 Changes in the demand for skilled labor within U.S. manufacturing: Evidence from 
the annual survey of manufacturers. Quarterly Journal of Economics 109:367-97. 

Bishop, John 

1989 Incentives for learning: Why American high school students compare so poorly to 
their overseas counterparts. Pp. 17-52 in Labor Economics and Public Policy , Research 
in Labor Economics, Vol. II, L.J. Bassi and D.L. Crawford, eds. Greenwich CT: JAI 
Press. 

1992 The Impact of Academic Competencies on Wages, Unemployment, and Job Perfor- 
mance. Camegie-Rochester Conference Series on Public Policy 37:127-194. 

1993 Improving job matches in the U.S. labor market. Pp. 335-400 in Microeconomics , Vol. I, 
Brookings Papers on Economic Activity. Washington, DC: Brookings Institution. 

1 995 Is the Market for College Graduates Headed for a Bust? Demand and Supply Responses 
to Rising College Wage Premiums. Working paper, Cornell University, Ithaca, NY. 

Black, Sandra, and Lisa Lynch 

1995 Human Capital Investments and Productivity. Mimeo, Harvard University, Cam- 
bridge, MA. 

Blau, Francine, and Lawrence Kahn 

1994 Rising wage inequality and the U.S. gender gap. American Economic Review 84: 23-28. 

Bound, John, and Richard Freeman 

1992 What went wrong? The erosion of relative earnings and employment among young black 
men in the 1980’s. Quarterly Journal of Economics 107:201-232. 



o 

ERIC 



33 



HARRY J. HOLZER 



29 



Bound, John, and Harry Holzer 

1995 Demand Shifts, Labor Market Outcomes, and Population Adjustments: 1980-1990. 
Mimeo, Michigan State University, East Lansing. 

Bureau of Labor Statistics 

1 984 The Impact of Technology on Labor in Four Industries : Hosiery/Folding Paperboard 
Boxes/Metal Cans/Laundry and Cleaning. Bulletin 2182. Washington, DC: U.S. De- 
partment of Labor. 

1 986 Technology and Its Impact on Labor in Four Industries: Tires/Aluminum/Aerospace/Bank- 
ing. Bulletin 2242. Washington, DC: U.S. Department of Labor. 

Burtless, Gary 

1 995 The employment prospects of welfare recipients. Pp. 71-1 06 in The Work Alternative, D. 
Nightingale and R. Haveman, eds. Washington, DC: Urban Institute Press. 

Bushway, Shawn 

1995 Labor Market Effects of Permitting Employer Access to Criminal History Records. 
Mimeo, Camegie-Mellon University, Pittsburgh, PA. 

Cameron, Steven, and James Heckman 

1993 The nonequivalence of high school equivalents. Journal of Labor Economics 11(1, Part 
1): 1-47. 

Cappelli, Peter 

1995a Is the “skills gap” really about attitudes? California Management Review 37(4): 108-124. 

1995b Technology and skill requirements: Implications for establishment wage structures. New 
England Economic Review (May-June): 139- 154. 

1996 Rethinking Employment. British Journal of Industrial Relations 33:563-602. 

Card, David, and Alan Krueger 

1994 Minimum wages and employment: A case study of the fast-food industry in New 
Jersey and Pennsylvania. American Economic Review 84:772-793. 

Camevale, Anthony, Leila Gainer, and Ann Meltzer 

1990 Workplace Basics: The Essential Skills Employers Want. New York: Josscy-Bass. 

Case, Karl, and Ray Fair 

1996 Principles of Macroeconomics, 4th ed. Englewood Cliffs, NJ: Prentice-Hall. 

Clark, Kim, and Lawrence Summers 

1982 The dynamics of youth unemployment. Pp. 199-234 in The Youth Labor Market Prob- 
lem: Its Nature , Causes and Consequences, R. Freeman and D. Wise, eds. Chicago: 
University of Chicago Press. 

Diebold, Francis, David Neumark, and Daniel Polsky 

1996 Comment on Kenneth Swinnerton and Howard Wial, “Is job stability declining in the 
U.S. economy?” Industrial and Labor Relations Review 49:348-352. 

Dinardo, John, Nicole Fortin, and Thomas Lemieux 

1995 Labor Market Institutions and the Distribution of Wages, 1973-1992: A Semiparametric 
Approach. Working paper. National Bureau of Economic Research, Cambridge, MA. 

Ell wood, David 

1982 Teenage unemployment: Permanent scars or temporary blemishes? Pp. 349-390 in The 
Youth Labor Market Problems: Its Nature , Causes and Consequences, R. Freeman and 
D. Wise, eds. Chicago: University of Chicago Press. 

Employment and Training Institute 

1 994 Survey of Job Openings in the Milwaukee Metropolitan Area: Week of October 24, 1994. 
Milwaukee: University of Wisconsin. 

Farber, Henry 

1994 Are Lifetime Jobs Disappearing? Job Duration in the United States, 1973-93. Mimeo, 
Princeton University, Princeton, NJ. 




A 

<4 U 



30 



EMPLOYER SKILL NEEDS AND THE SKILLS OF THE WORK FORCE 



Feldstein, Martin, and James Poterba 

1984 Unemployment insurance and reservation wages. Journal of Public Economics 23(1- 
2): 141-167. 

Ferguson, Ronald 

1993 New Evidence on the Growing Value of Skill and Consequences for Racial Disparity 
and Returns to Schooling. Mimeo, Harvard University, Cambridge, MA. 

Flinn, Christopher, and James Heckman 

1993 Are unemployment and out of the labor force behavioraiiy distinct states? Journal of 
Labor Economics l(l):28-42. 

Freeman, Richard 

1 994 Crime and the Job Market. Working paper. National Bureau of Economic Research, 
Cambridge, MA. 

1 995a Are your wages set in Beijing? Journal of Economic Perspectives 9(3): 15-32. 

1995b Incarceration v. the Dole: U.S. and European Modes of Dealing with Unskilled Men. 
Mimeo, Harvard University, Cambridge, MA. 

1995c Labor Market Institutions and Earnings Inequality. Mimeo, Harvard University, 
Cambridge, MA. 

Freeman, Richard, and Lawrence Katz 

1994 Rising wage inequality: The U.S. v. other industrial countries. Pp. 29-62 in Working 
Under Different Rules , R. Freeman, ed. New York: Russell Sage Foundation. 

Goldberger, Arthur, and Charles Manski 

1995 The bell curve: A perspective from economics. Focus (FallAVinter): 23-24. 

Goldin, Claudia, and Lawrence Katz 

1995 The Decline of Non-Competing Groups: Changes in the Premium to Education, 1890- 
1940. Working paper. National Bureau of Economic Research, Cambridge, MA. 

Griliches, Zvi 

1996 Education, Human Capital . and Growth: A Personal Perspective. Working paper, Na- 
tional Bureau of Economic Research, Cambridge, MA. 

Grissmer, David, Sheila Kirby, Mark Berends, and Stephanie Williamson 

1994 Student Achievement and the Changing American Family . Santa Monica, CA: RAND 
Corporation. 

Hamermesh, Daniel 

1993 Labor Demand. Princeton, NJ: Princeton University Press. 

Hauser, Robert, and Wendy Carter 

1995 The bell curve: A perspective from sociology. Focus (FallAVinter): 25-27. 

Hauser, Robert, and Hanam Samuel Phang 

1993 Trends in High School Dropout Among White, Black and Hispanic Youth: 1973 to 1989. 
Discussion paper. Institute for Research on Poverty, University of Wisconsin, Madison. 

Hecker, Daniel 

1992 Reconciling conflicting data on jobs for college graduates. Monthly Labor Review 
1 1 5(7):3-1 2. 

Herrnstein, Richard, and Charles Murray 

1994 The Bell Curve. New York: Basic Books. 

Holzer, Harry 

1987 Hiring procedures in the firm: Their economic determinants and consequences. Pp. 243- 
274 in Human Resources and the Performance of the Firm , M. Kleiner, R. Block, M. 
Roomkin, and S. Salsburg, eds. Madison, Wl: Industrial Relations Research Associa- 
tion. 

1989 Unemployment, Vacancies, and Local Labor Markets. Kalamazoo, MI: Upjohn Institute 
for Employment Research. 



HARRY J. HOLIER 



31 



1994 Job vacancy rates in the firm: An empirical analysis. Economica 6 1(241): 17-36. 

1996 What Employers Want: Job Prospects for Less-Educated Workers. New York: Russell 
Sage Foundation. 

Hunt, Earl 

1995 Will We Be Smart Enough? New York: Russell Sage Foundation. 

Ichniowski, Casey, Kathryn Shaw, and Giovanni Prennushi 

1995 The Effect of Human Resource Management Practices on Productivity. Working paper, 
National Bureau of Economic Research, Cambridge, MA. 

Jaeger, David 

1995 Skill Differences and the Effects of Immigrants on the Wages of Natives. Mimeo, 
University of Michigan, Ann Arbor. 

Jencks, Christopher 

1972 Inequality. New York: Basic Books. 

Juhn, Chinhui 

1992 Decline of male labor market participation: The role of declining labor market 
opportunities. Quarterly Journal of Economics 107:79-121. 

Juhn, Chinhui, Kevin Murphy, and Brooks Pierce 

1 993 Wage inequality and the rise in the returns to skill. Journal of Political Economy 1 0) :4 JO- 
442. 

Kane, Thomas 

1995 Rising Public College Tuition and College Entry: How Well Do Public Subsidies Pro- 
mote Access to College? Working paper no. 5164, National Bureau of Economic Re- 
search, Cambridge, MA. 

Karren, Robert 

1 980 The Selection Interview: A Review of the Literature. Washington, DC: Office of Person- 
nel Management. 

Kasarda, John 

1995 Industrial restructuring and the changing location of jobs. Pp. 215-167 in State of the 
Union , Vol. I, R. Farley, ed. New York: Russell Sage Foundation. 

Katz, Lawrence 

1986 Efficiency wages: A partial evaluation. NBER Macroeconomics Annual. National Bu- 
reau of Economic Research, Cambridge, MA. 

Katz, Lawrence, and Kevin Murphy 

1992 Changes in relative wages, 1963-87: Supply and demand factors. Quarterly Journal of 
Economics 107:35-78. 

Kirschenman, Joleen, and Katherine Neckerman 

1991 We’d love to hire them but Pp. 203-232 in The Urban Underclass , C. Jencks and P. 

Peterson, eds. Washington, DC: Brookings Institution. 

Kirschenman, Joleen, Philip Moss, and Chris Tilly 

1995 Employer Screening Methods and Racial Exclusion: Evidence from New In-Depth 
Interviews with Employers. Mimeo, Russell Sage Foundation, New York. 

Kling, Jeffrey 

1995 High performance work systems and firm performance. Monthly Labor Review 1 18:29- 
36. 

Krueger, Alan 

1993 How computers have changed the wage structure: Evidence from microdata, 1984-89. 
Quarterly Journal of Economics 108:33-60. 

Levy, Frank, and Richard Murnane 

1992 U.S. earnings levels and earnings inequality: A review of recent trends and proposed 
explanations. Journal of Economic Literature 30(3): 1 333- 1381. 



ERjd 





32 



EMPLOYER SKILL NEEDS AND THE SKILLS OF THE WORK FORCE 



1995 With What Skills Are Computers a Complement? Mimeo, Massachusetts Institute of 
Technology, Cambridge, MA. 

Lynch, Lisa 

1992 Private sector training and the earnings of young workers. American Economic Review 
82:299-312. 

1993 The economics of youth training in the United States. Economic Journal 103:1292- 
1302. 

Madrick, Jeffrey 

1995 The End of Affluence. New York: Random House. 

Meyer, Robert, and David Wise 

1982 High school preparation and early labor market experience. Pp. 27-348 in The Youth 
Labor Market Problem : Its Nature, Causes and Consequences , R. Freeman and D. Wise, 
eds. Chicago: University of Chicago Press. 

Mincer, Jacob 

1 994 Investment in U.S. Education and Training. Working paper no. 4844, National Bureau of 
Economic Research, Cambridge, MA. 

Moss, Philip, and Chris Tilly 

1 995 Soft Skills and Race: An Investigation of Black Men 's Employment Problems. Working 
paper, Russell Sage Foundation, New York. 

Murnane, Richard 

1995 Is the Market for College Graduates Headed for a Bust? Demand and Supply Re- 
sponses to Rising College Wage Premiums. Mimeo, Harvard University, Cambridge, 
MA. 

Murnane, Richard, John Willett, and Frank Levy 

1995 The Growing Importance of Cognitive Skills in Wage Determination. Review of Eco- 
nomics and Statistics 77:251-266 . 

National Center on the Educational Quality of the Workforce 

1995 First Findings from the EQW National Employer Sur\>ey. University of Pennsylvania, 
Philadelphia, PA 

Neal, Derek, and William Johnson 

1995 The Role of Pre-market Factors in Black-White Wage Differences. Working paper no. 

5 1 24, National Bureau of Economic Research, Cambridge, MA. 

Neumark, David, and William Wascher 

1 995 Minimum-wage effects on school and work transitions of teenagers. American Economic 
Review 85 (2): 244-249. 

New York City Department of Employment 

1995 New York City Employer Survey: What Employers Require for Employment. Re- 
search report no. I, New York City Department of Employment. 

Nickel 1, Steven 

1 997 The collapse in demand for the unskilled: What can be done? In Demand-Side Strategies 
for Low-Wage Labor Markets , R. Freeman and P. Gottschalk, eds. New York: Russell 
Sage Foundation, forthcoming. 

O’Neill, June 

1 990 The role of human capital in earnings differences between black and white men. Journal 
of Economic Perspectives 4(4): 25-45. 

Packer, Arnold, and John Wirt 

1992 Changing skills of the U.S. workforce: Trends of supply and demand. Pp. 31-80 in Urban 

Labor Markets and Job Opportunities , G. Peterson and W. Vroman, eds. Washington, 
DC: Urban Institute Press. 




43 



HARRY J. HOLIER 



33 



Piehl, Anne 

1995 Earnings Inequality and Incarceration over the 1980’s. Mimeo, Harvard University, Cam- 
bridge, MA. 

Rich, Lauren 

1994 The Long-Run Impact of Early Nonemployment: A Reexamination. Mimeo, Uni- 
versity of Michigan, Ann Arbor. 

Rivera-Batiz, Francisco 

1992 Quantitative literacy and the likelihood of employment among young adults in the 
United States. Journal of Human Resources 27(2):3 13-328. 

Rodgers, William, and William Spriggs 

1995 What Does the AFQT Really Measure? Race, Wages, Schooling and the AFQT Score. 
Unpublished paper, The College of William and Mary, Williamsburg, VA. 

Swinnerton, Kenneth, and Howard Wial 

1995 Is job stability declining in the U.S. economy? Industrial and Labor Relations Review 
48(2):293-304. 

1996 Is job stability declining in the U.S. economy? Reply to Diebold, Neumark and 
Polsky. Industrial and Labor Relations Review 49(2):352-355. 

Weiss, Andrew 

1995 Human capital v, signalling explanations of wages. Journal of Economic Perspectives 
9(4): 133-154. 

Wilson, William 

1987 The Truly Disadvantaged. Chicago: University of Chicago Press. 




A 1 

q ^ 



3 

Skills and the Economy: 

An Employer Context for Understanding 
the School-to-Work Transition 



Robert Zemsky 



INTRODUCTION 

Today, two linked propositions frame many of the policies and much of the 
analyses focusing on the school-to-work transition: young workers need to pos- 
sess more of the skills employers seek; and, if employers would only inform 
educators of the specific nature of those skills, schools could provide the requisite 
training and education. The role of public policy thus becomes one of convincing 
schools to listen to employers — to negotiate with them, really — and to persuade 
employers that the resulting improvement in young people’s job readiness would 
be worth the additional taxes (Reich, 1991 ; National Center on Education and the 
Economy, 1990). 

Over the last five years the work of my colleagues and I at the National 
Center on the Educational Quality of the Workforce (EQW) has persuaded us that 
this scenario — for all its symmetry and appeal to the ideal of a better-educated 
work force — does not correspond to the conditions we found as we worked with 
and surveyed employers on issues regarding the school-to-work transition. Much 
of the experience with school-business partnerships, for example, testifies to just 
how difficult it is for employers to articulate what skills they will require in the 
future, much less for schools to see employers as customers (Miller, 1988, 1991; 
McDermott, 1989; Rachlin and Shapiro, 1989; Spring, 1987). And most of the 
statistical evidence suggests that what today’s young workers face is job ration- 
ing and declining real wages either because there are insufficient opportunities to 
absorb the skills they bring with them to the labor market or because employers 
do not want to hire them. 1 



'The most successful presenters of this argument have been Robert Reich (1991) and the authors of 
America s Choice : High Skills or Low Wages (National Center on Education and the Economy, 1990). 
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The principal advantage enjoyed by young workers today is that there are 
fewer of them. At the beginning of the 1980s, there were more than 27 million 
young people aged 16 to 26 who were not enrolled in school and who either had 
or were seeking full-time employment. Ten years later that same youth cohort 
(16 to 26) numbered just 22 million. With fewer young people competing for 
jobs, their participation in the labor force actually increased slightly, from 69 
percent in 1981 to 70 percent in 1991, while the proportion of those working full 
time increased from 75 to 79 percent over the same decade. (The discussion of 
youth labor market characteristics presented in this and succeeding paragraphs is 
drawn from an analysis of the Current Population Survey contained in Making 
Good Jobs for Young People a National Priority , a publication of the National 
Advisory Board of the National Center on the Educational Quality of the 
Workforce, 1995a). 

Offsetting this slight increase in employment, however, are three significant 
losses that substantially disadvantage this and succeeding generations of young 
people. In 1981, 19 percent of young workers in the United States were em- 
ployed in full-time jobs in the manufacturing sector. Ten years later only 15 
percent of youth worked full time in the same sector — a net loss of 1 .65 million 
manufacturing jobs for young workers. At the same time, the proportion of full- 
time manufacturing jobs held by workers aged 16 to 26 fell from 23 percent in 
198 1 to 1 6 percent in 1991. 

Changes in the armed services tell much the same story. In 1987 the armed 
services enlisted almost 300,000 new recruits — for the most part, young people 
with high school degrees but little subsequent postsecondary education. By 
1993, these annual accessions to the military had been reduced by one-third, 
which meant 100,000 fewer recruits each year. The number is expected to drop 
even further as the military continues to downsize. What will be lost by the end 
of the decade are almost 1 million good jobs for young people: jobs with good 
pay, excellent benefits, opportunities to acquire technical skills, and further edu- 
cational benefits after service (Barley, 1994; Laurence, 1994). 

Not surprisingly, this decline in good jobs for young people has been accom- 
panied by a general and persistent decline in the wages paid to them. Compared 
with their counterparts of a decade ago, young workers in the United States are 
more likely to have jobs for which they are paid less. When education, gender, 
race or ethnicity, and industry of employment are taken into account, young 
workers today earn, on average, more than 10 percent less in constant dollars than 
their counterparts a decade ago. For disadvantaged youth and those without high 
school credentials, the decline has been even more dramatic. 

The strategy of schools’ negotiating with employers to yield more work- 
relevant courses of study, resulting in the production of more work-ready young 
graduates, has proven to be difficult to implement. It is the dream of every school 
reformer committed to devising more work-relevant and/or work-based curricula 
to sit across the table from a group of employers who are ready and willing to tell 
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the schools what they need. Much of the initial logic behind the current concern 
with the school-to-work transition derives from this promise: “If only concerned 
employers will tell us what they need, we can make sure that our schools deliver.” 
Skeptics have suggested that schools do not work that way — that they are not 
customer centered, that they are more likely to draw on their own sense of what 
constitutes a good education than to ask what businesses need. Even more 
difficult, however, would be getting employers to the table, in part because they 
have given up on schools and in part because most employers do not know how 
to answer the question of what skills will they need in the future (Bailey, 1993; 
Doolittle and Ivry, 1993; Kazis, 1993b; Levy and Murnane, 1993; Osterman and 
Iannozzi, 1993; Stem, 1993). 

The idea of a negotiated compact between schools and employers has its 
roots in the school reform movement of the late 1970s and early 1980s. Reform- 
ers wanted schools to gain a better sense of their customers and wanted those 
customers to help spur the reform movement itself. Initially, it was an idea that 
was pitched almost exclusively to the nation’s major employers, those with suffi- 
cient corporate clout to make schools pay attention. Most major cities developed 
business-school partnerships of one form or another, each designed to enable 
schools and teachers to gain a better understanding of what the business commu- 
nity needed and for what it was willing to pay. 2 

In practice, however, many of the business men and women brought to the 
table by these partnerships had little firsthand knowledge of the skills their enter- 
prises needed and whether, in fact, their businesses were having trouble finding 
qualified young workers. Most of the business seats at the “bargaining table” 



2 The causes underlying the declining fortunes of young workers are now the subject of a lively 
debate in the United States. On one side are those who argue that the problem lies with the prepara- 
tion of young people for work — with their schooling and their antipathy to the discipline of work 
itself. These scholars and commentators would increase opportunities for young people largely 
through an aggressive agenda of school reform. Increase the skills and improve the attitudes young 
people bring with them to the labor market, they argue, and employment will follow. Within this 
agenda, probably the most radical proposal would have established a German-style apprenticeship 
system in the United States. 

Those of us who hold the alternative view argue that — whatever the problems inherent in the skills 
and attitudes of young people — the larger problem is one of demand, not supply. As the American 
economy has undergone restructuring and its firms have reengineered their enterprises, employers 
have learned to thrive with fewer of the kind of entry-level positions historically filled by young 
workers. 

The debate has, on occasion, become confounded with a more technical discussion of a secular 
shift in labor demand. The general consensus is that those with more skills have found it easier to 
find jobs paying higher wages than those with fewer skills. I have no quarrel with this consensus, 
except to note, as the text indicates, that on average all young people have lost ground in the pursuit 
of higher wages — those who have more skills have lost less ground than those who have fewer skills. 
This is also the point Sam Stringfield makes in a provocative analysis of schooling programs that 
enhance skills (Stringfield, 1995). For other research that parallels EQW’s, see Mishel and Teixeira 
(1991). 
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were occupied by chief executive officers, business’s “first citizens” long since 
removed from the hurly-burly of meeting production schedules and hiring and 
training new workers. Their notions of education were more general than spe- 
cific, more likely to stress broad academic competencies than narrow technical 
skills. What the schools derived from these partnerships was not information but 
help — help in setting higher standards for graduation, in taking on the tough tasks 
of school restructuring, and in making the case for increased public support. 

The downsizing of corporate America has been accompanied by an under- 
standable lessening of business interest in the process, if not the progress, of 
school reform. There is less concern over the supply of future workers; there are 
also fewer of the professional staff members in large corporations who once 
regularly contributed to the operation of business-school partnerships. Yet iden- 
tifying where and when these partnerships have persisted is an instructive exer- 
cise. As a general category, the most active partnerships today are in the form of 
private industry councils, established as part of the Jobs Training Partnership Act. 
When they work, they do so because employers are seen as customers with 
immediate needs for workers who know how to find and keep a job (Filipczak, 
1993; National Commission for Employment Policy, 1993; DiMase and Boyle, 
1991; Ketcham, 1990). Private industry councils have learned the tough lesson 
that the skills most needed concern comportment and the capacity to sell oneself 
in a buyer’s market. 

Though on a substantially smaller scale, business-school partnerships have 
also come to play an important role in the establishment of charter schools — 
educational institutions that are publicly funded but operate as quasi-independent 
schools responsible to a local board. Some of the most successful charter schools 
have been those driven by business-dominated boards assembled to make sure 
that the schools serve local employers as well as students. The board does not 
negotiate curricula on behalf of the business community, but rather insists that 
those responsible for the curricula are “out in the community” learning what 
employers want — that is, performing the kind of market research on which most 
successful enterprises depend (Lynn and Wills, 1994; Bailey and Merrit, 1993; 
Finegold, 1993; Hamilton and Hamilton, 1993; Kazis, 1993a; William T. Grant 
Foundation, 1992; Glennan, 1991; Barton, 1990; Carnevale et al., 1990; Educa- 
tion Writers Association, 1990; Glover, 1983). 

It is important to note, however, that charter schools are the exception and 
not the rule. The reality that faces most young people, as well as most schools, is 
increasingly uncertain. The time between the conclusion of schooling and the 
securing of a permanent job is getting longer. The link between formal schooling 
and settled work is becoming more tenuous, while the possession of post- 
secondary credentials is becoming more essential. 3 

3 In their analysis of job churning, Diebold et al. (1994) concluded that jobs in the 1990s were 
neither more nor less stable than during earlier decades — except for young workers, who experi- 
enced increased. churning. 
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What schools are now discovering is that somehow they have come to matter 
less in the nation’s economic calculus. They are more badgered than supported 
and are more likely to be blamed for what has gone wrong than to be assisted in 
implementing what might make it right. They are told that the students they 
graduate have not mastered basic problem-solving competencies, that too often 
they know little or nothing about the world of work, and that all too often they 
appear, particularly to would-be employers, as undisciplined and disinterested in 
work itself (Zemsky, 1994). Schools know they are being discounted, discon- 
nected, and finally dismissed by more and more employers. 4 What they sense, as 
well, is that the link between education and the nation’s productivity is itself at 
risk, to the detriment of both school and community (Shanker, 1995). 



THE EQW NATIONAL EMPLOYER SURVEY 

In the spring of 1995 the EQW reported the results of the first analysis of the 
its National Employer Survey — findings that documented just how much em- 
ployers discounted information about a job applicant’s schooling when making 
hiring decisions. The survey was designed by EQW, a joint venture of the 
University of Pennsylvania’s Institute for Research on Higher Education and the 
Wharton School. This first nationally representative survey to test the link be- 
tween employers and schools queried the managers and owners of just over 4,000 
establishments employing 20 workers or more about their employment, training, 
and hiring practices. To capture the underlying factors that yield increases in 
productivity, respondents were also asked about the basic nature of their busi- 
nesses: annual sales, principal products and services, investments in new equip- 
ment and new facilities, costs of materials used in production, and the average 
wages and levels of education of their workers (Lynch and Black, 1996a, 1996b; 
National Center on the Educational Quality of the Workforce, 1996). 5 

The EQW survey represents the culmination of 5 years of research that asked 
one of the basic questions motivating the National Research Council Board on 



4 EQW has received a great deal of correspondence from teachers, school administrators, and 
education officials expressing the difficulties in establishing successful links between education and 
the workplace. Two such letters stand out, sent by Alex May, technology supervisor for the Millville 
Public Schools in Millville, NJ, and by Edward Roeber, director of Student Assessment Programs for 
the Council of Chief State School Officers. EQW has also received correspondence from employers 
engaged in implementation of state and local school-to-work initiatives; one such employer is C. 
Arnold Decker, executive vice-president of the Sumter Cabinet Company in South Carolina, who has 
sought advice on facilitating partnerships with local schools. These three letters were received in 
response to EQW’s policy statement, On Connecting School and Work (National Advisory Board of 
the National Center on the Educational Quality of the Workforce, 1995b), which discusses the 
discounting of schools by employers referenced here. 

5 These and related EQW materials are available free of charge from the National Center on the 
Educational Quality of the Workforce (EQW, University of Pennsylvania, 4200 Pine St,, 5 A, Phila- 
delphia, PA 19104-4090; 1-800-437-9799; e-mail: eqw-requests@irhe.upenn.edu). 
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Testing and Assessment’s interest in the school-to-work transition: What is it 
that employers want? In designing the research agenda, EQW assumed that the 
term “labor market” was more than a convenient metaphor wrapped in economic 
jargon — that there were in fact buyers and sellers in the form of employers, on the 
one hand, and schools and their graduates on the other. Having conceived of the 
school-to-work transition as the sum of a set of employee-seeking and job-find- 
ing transactions, we at EQW saw our task as essentially one of market research 
that could tell us what the employer/consumer was looking for and what schools 
as suppliers might best do with that information. In other words, we wanted to 
identify how schools might change what they do in order to make employers 
more informed— and, in that sense, more reliable customers. 

Our focus was on the establishment rather than the firm because that is where 
most decisions to hire new workers occur. We wanted to know how hiring 
decisions were made, what type of information proved to be helpful, what skills 
as well as credentials employers considered to be important, and what kinds of 
training they provided for their employees. We wanted to know whether the most 
productive establishments within any given industry either hired or trained their 
workers differently than less productive competitors. Finally, to construct the 
necessary survey instruments and interview protocols, we wanted to know some- 
thing about the attitudes employers had toward youth employment and the school- 
to-work transition. Our answers to these questions came in three basic bundles. 

HOW EMPLOYERS TALK 

We began our investigation with focus groups of employers in seven cities 
across the United States: Portland and Eugene, Oregon; Phoenix, Arizona; India- 
napolis, Indiana; Cleveland, Ohio; Atlanta, Georgia; and Ithaca, New York. 
Whenever possible, we conducted two sessions per city — one drawing together 
human resource professionals from larger firms and the other consisting of small- 
business owners. The discussions themselves were remarkably similar across the 
focus groups, and the problem on which each focus group stumbled was the 
same: employers acknowledged that they ought to, but simply did not, see 

themselves as benefiting from their community’s investments in work-related 
education (Zemsky, 1994). 

The most discouraging discussions occurred when we asked about the em- 
ployability of young people. In part, employers’ laments incorporated the peren- 
nial concerns of older people about a generation that must inevitably replace 
them: young people lack discipline; they expect to be catered to; they don t want 
to do the dirty jobs; they don’t respect authority. To these more or less traditional 
concerns were added worries about the quality of educational attainment: young 
people lack communication skills; they are neither numerate nor literate; they 
can’t make change; they don’t understand the importance of providing customer 
service (Zemsky, 1994). 
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These complaints were more than a fashionable echoing of the media’s 
current fascination with educational deficiencies. Almost everyone had a story to 
tell— dealing with honors students who couldn’t spell; sifting through hundreds 
of job applications and resumes in search of potential candidates capable of 
making a reasonably neat and complete presentation of their skills and aptitudes; 
firing one young worker after another who did not measure up on the job. The 
owner of one fast-food franchise reported that the average tenure of a first-time 
young worker was less than 2 weeks; often the owner would make up to eight 
hires before finding a new worker who could last longer. 

This sense of “trial-and-error” hiring, rather than the successful screening of 
job applicants based on educational attainment, came to dominate the discus- 
sions. Most employers no longer expected high schools to supply their future 
workers. With the exception of fast-food franchises, businesses were finding the 
most likely pool of youth labor not among high school students but among 
college students, even college graduates. Put off by the young and saddened by 
their local high schools but without any interest in changing them, most employ- 
ers with whom we talked had simply shifted their attention to the next age cohort, 
focusing on those in their mid-twenties or older. Given the surplus of younger 
people looking for work, employers had little trouble finding “older” young 
employees, frequently with 2 or more years of college. These individuals were 
depicted as the survivors — those with sufficient discipline, experience, skills, and 
motivation to be worth hiring. 



ESTABLISHING A BASELINE 

The EQW National Employer Survey documented what the focus groups 
reported. The survey was designed by Lisa Lynch, who is currently chief econo- 
mist with the U.S. Department of Labor, in collaboration with EQW co-directors 
Peter Cappelli and Robert Zemsky. It was administered by the U.S. Bureau of the 
Census as a telephone survey in the late summer and early fall of 1994. The 
survey’s sampling frame was the Census Bureau’s Standard Statistical Establish- 
ment List, one of the most comprehensive and up-to-date listings of establish- 
ments in the United States. The EQW National Employer Survey oversampled 
establishments in the manufacturing sector and those with more than 100 em- 
ployees. Public-sector employers, not-for-profit institutions, and corporate head- 
quarters were excluded from the sample. The survey also excluded establish- 
ments with less than 20 employees, largely because of the difficulties inherent in 
drawing a reliable sample of small establishments. While these employers repre- 
sent 85 percent of all establishments, they employ less than 25 percent of all 
workers (Lynch and Black, 1996a). 

In all, 4,633 eligible establishments were contacted, of which 3,358 agreed 
to participate — a 72.5 percent response rate. Most refusals stemmed from the 
employer’s reluctance to participate in a voluntary survey and to spend the requi- 
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site amount of time. There was no significant pattern to the refusals, except for 
manufacturing establishments with more than 1,000 employees. 

The target respondent in manufacturing establishments was the plant man- 
ager and in nonmanufacturing establishments the local site manager. Multiple 
respondents were allowed for each establishment, typically because the inter- 
viewer was told that information such as annual sales or investments in physical 
capital could be better obtained from another manager or office within the same 
establishment. Just over 12 percent of the surveys were not included in the 
analysis, principally because the Census Bureau was not able to complete the 
interviews prior to October 1, the cutoff date designated in the survey design. 
The completed survey rate was thus 64 percent, and the survey results reported 
below are based on weighted results drawn from the complete responses. 

It was intended that the EQW survey would provide a baseline for comparing 
employer attitudes, their estimation of employees’ skills and proficiencies, in- 
vestments in both formal and informal employee training, the type of information 
for which they looked when hiring new employees, and the collective as well as 
individual contributions that these characteristics appeared to make to an 
establishment’s productivity. What we sought was a reality check — a counter- 
balance to the anecdotes that have become the almost exclusive source for esti- 
mates of how and when employers invest in the skills of their employees, the 
kinds of skills that will be required in the future, and the extent to which employ- 
ers are likely to rely on schools to supply those skills. 

We begin by noting that the restructuring of the American economy has not 
led to a deskilling of work. Quite the contrary, as Table 3- 1 shows, only 5 percent 
of the establishments reported any reduction in the skill requirements of their 
jobs, while 56 percent reported increased skill requirements. 

Employers’ assessment of employee proficiency was more mixed. On aver- 
age, establishments reported that just over 80 percent of their workers were fully 
proficient in their current jobs. That means that one out of every five workers was 
judged as being not fully proficient (see Table 3-2). Despite the richness of the data 
supplied by the EQW National Employer Survey, we were unable to construct a 
satisfactory model for identifying those attributes that either contributed to or sub- 



TABLE 3-1 Percentage of Establishments That Have Increased, Decreased, 
or Not Changed Their Skill Requirements 



Change in Skill Requirements 


% Establishments 


Increased 


57 


Decreased 


5 


Remained the same 


39 



NOTE: Data derived from Question 14 on the EQW National Employer Survey: “In the last three 
years, have the skills required to perform production or support jobs (primary or frontline services or 
support jobs) at an acceptable level increased, decreased, or remained the same in your establish- 
ment?” 
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TABLE 3-2 Percentage of Employees Proficient at Their Jobs 



Proficient Employees" 


% Establishments 


< 75% 


32 


> 75% and < 85% 


21 


> 85% and < 95% 


27 


> 95% 


19 



“Mean employee proficiency across establishments = 80% 

NOTE: Data derived from Question 37 on the EQW National Employer Survey: “What percentage 
of your workers would you regard as being fully proficient at their current jobs? 



tracted from employer-supplied estimates of worker proficiency. We suspect that 
part of the answer lies in the high rates of turnover during the first year of employ- 
ment reported by some firms. Another part of the answer may lie in the fact that the 
skill requirements for many current jobs are actually increasing — that workers were 
being required to “catch up” by acquiring new skills. 

The EQW survey provides two additional benchmarks for gauging employ- 
ers current estimates of the skills and capacities of their employees. Almost 
universally, employers reported that they invested in employee training — infor- 
mally through on-the-job training or its equivalent (97 percent) and formally 
through structured training programs (81 percent). As expected, large establish- 
ments were more likely to provide formal training than smaller ones, but even 
then, three out of four of the smallest establishments (20 to 49 employees) re- 
ported that they provided some formal training (see Table 3-3). 

At the same time, there is little evidence that establishments were finding it 

necessary to make significant investments in either remedial or basic education 

that employers either were having to fix what schools had gotten wrong or had to 
spend time or money bringing employees up to minimum skill standards (see 
Table 3-4). Indeed, we interpret the substantial investment that establishments 
were making in employee training to mean these employers had confidence in 
both the skills and the trainability of their work force. 

The general conclusions drawn from the EQW National Employer Survey 
were that work and the organization of work are becoming more complex, that 
most establishments report their jobs require increased skills, and that most em- 
ployers are investing in the skills of their workers partly to make them proficient 
in their current jobs but not to provide remedial training or education. 



EDUCATION’S CONTRIBUTION TO ESTABLISHMENT 
PRODUCTIVITY 

Another way to ask the “skills question” is to determine to what extent, if 
any, education contributes to establishment productivity. Here, I draw directly 
on the work of Lynch and Black (1996a), who used data from the EQW National 
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TABLE 3-3 Establishments Offering Formal and Informal Training by 
Establishment Size 





% Firms 


% Firms 


No. of 


Providing Formal 


Providing Informal 


Employees 


Training 


Training 


All 


81 


97 


20 to 49 


75 


96 


50 to 99 


82 


99 


100 to 249 


90 


98 


250 to 999 


90 


99 


More than 1 ,000 


99 


98 



NOTE: Information on formal training derived from Question 18 of the EQW National Employer 
Survey: “Does your establishment pay for or provide any structured or formal training either on the 
job (by supervisors or outside contractors) or at a school or technical institute?” Information on 
informal training derived from Questions 19 and 32b of the EQW National Employer Survey. Ques- 
tion 19 (for establishments that do not provide formal training) is “Unstructured or informal training 
includes situations in which employees learn by observing others doing a job in an informal one-on- 
one situation. Does your establishment provide informal (in-plant) instruction by supervisors or co- 
workers?” Question 32b (for establishments that provide formal training) is “Unstructured or infor- 
mal training includes situations in which employees learn by observing others doing the job or are 
shown how to do a job in an informal one-on-one situation. In addition to your formal training 
program, does your establishment provide informal (in-plant) instruction by supervisors and co- 
workers?” 

Employer Survey to estimate a standard Cobb Douglas production function. The 
output variable takes as its proxy the log of sales for calendar year 1993. The 
input variables/proxies are the 1993 book value of the capital stock; the total cost 
of goods and services used in the production of 1993 sales, including energy; 
total labor hours for 1993; and the average educational level of workers. The 
results of this unrestricted Cobb Douglas production function are reported sepa- 
rately for manufacturing and nonmanufacturing establishments in columns 1 and 
3 of Table 3-5 (Lynch and Black, 1996a). 



TABLE 3-4 Relative Ranking of Amount of Time Establishments Spend on 
Various Types of Training 



Type of Training 


Rank" 


Training on the safe use of equipment and tools 


1.7 


Improving teamwork or problem-solving skills 


1.5 


Training in sales and customer service 


1.5 


Training to use computers and other new equipment 


1.4 


Remedial skills in literacy and arithmetic 


0.4 



«0 = none; 1 = little; 2 = some; 3 = most. 

NOTE: Data derived from Question 28 on the EQW National Employer Survey: “Regarding your 
nonmanagerial and nonsupervisory employees, how much of their time in formal training is spent 
performing activities in the following categories?” 

o 
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TABLE 3-5 Restricted and Unrestricted Cobb Douglas Producti on Function 

Dependent Variables 

Manufacturing Nonmanufacturing 

Explanatory Log 

Variables Log (S) n (S/hours*ED) fc L og (S) (S/hours*ED) 

Constant 



Log capital 

Log (K/hours*ED) c 

Log materials 

Log (materials/hours*ED) 

Log hours 

Multiestablishment firm 
% Equipment < 1 year old 
% Equipment 1-4 years old 
Log average education 
Log trained 1993 
Log trained 1990 
% workers < 1 year 
Unionized 

Total quality management 

Benchmark 

Above capacity 

Below capacity 

Export 

R & D 
Center 

Birth year of establishment 



0.341 


1 .06" 


(0.317) 


(7.335) 


0.25 rf 


— 


(11.304) 


0.25^ 


0.26^ 


(11.311) 


(1 1.812) 


0.26' 7 


0.47^ 


(11.84) 


(12.45) 

0A3 d 


0.12^ 


(2.257) 


(2.183) 


-0.003 


-0.003 


(-1.331) 


(-1.288) 


0.003^ 


0.003' 7 


(2.153) 


(2.178) 


0.86^ 


— 


(2.028) 

-0.12 


-0.12 


(-1.294) 


(-1.356) 


0.09 


0.09 


(0.994) 


(1.030) 


-0.003 


-0.003* 


(-1.61) 


(-1.692) 


-0.05 


-0.06 


(-0.793) 


(-0.952) 


-0.02 


-0.03 


(-0.347) 


(-0.483) 


0.03 


0.032 


(0.539) 


(0.558) 


0.21 8^ 


0.2 1 ^ 


(2.114) 


(2.063) 


-0.005 


0.001 


(-0.10) 


(-0.011) 


0.10* 


0.10* 


(1.845) 


(1.796) 


-0.01 


-0.01 


(-0.200) 


(-0.133) 


0.001 


0.001 


(1.26) 


(1.428) 



-1.252 


0.946'' 


(-0.659) 


(2.717) 


0.36^ 


— 


(9.957) 


— 


0.35'' 

(9.959) 


0.06'' 


— 


(2.958) 


— 


0.06^ 

(2.971) 


0.628* 


— 


(10.948) 


-0.05 


-0.02 


(-0.382) 


(-0.163) 


0.005 


0.005 


(1.249) 


(1.327) 


-0.0003 


-0.0004 


(-0.155) 


(-0.181) 


1.29* 


— 


(1.793) 


0.08 


0.07 


(0.39) 


(0.355) 


-0.1 1 


-0.09 


(-0.515) 


(-0.425) 


-0.008^ 


-0.009^ 


(-2.692) 


(-2.875) 


0.35' 7 


0.38' 7 


(2.494) 


(2.722) 


-0.01 


-0.001 


(-0.121) 


(-0.012) 


0.08 


0.09 


(0.621) 


(0.721) 


0.37* 


0.36* 


(1.816) 


(1.796) 


0.005 


-0.009 


(0.047) 


(-0.076) 


-0.05 


-0.0 


(-0.338) 


(-0.157) 


-0.05 


-0.04 


(-0.334) 


(-0.265) 


0.0004 


0.0002 


(0.164) 


(0.087) 
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TABLE 3-5 Continued 



Explanatory 

Variables 




Dependent Variables 




Manufacturing 


Nonmanufacturing 


Log (s r 


Log 

(S/hours *ED)^ 


Log (S) 


Log 

(S/hours*ED) 


Industry controls 


yes 


yes 


yes 


yes 


Summary statistics: 










N 


821 


821 


525 


525 


Adjusted squared multiple 








correlation (R^) 


0.8387 


0.4331 


0.6512 


0.3814 



"S = sales 

^ED = average educational level of workers 
C K = capital stock 
<lp < .05. 

e p < . 1 . 

NOTE: t tests are given in parentheses. 



Lynch and Black also estimated a restricted Cobb Douglas production func- 
tion in which the proxy for the quality of labor is rewritten as the product of labor 
hours times average education. The results for the restricted estimation are 
presented in Table 3-5, column 2 for manufacturing and column 4 for nonmanu- 
facturing establishments. 

Two sets of findings emerge from this analysis. The first is that education 
matters — indeed, substantially. In the restricted model the implied coefficient on 
education suggests that a 10 percent increase in the average education of an 
establishment’s work force raises productivity by 4.9 percent in the manufactur- 
ing sector and 5.9 percent in nonmanufacturing. Second, training — that is, fur- 
ther job-related education — also has an impact on productivity. For manufactur- 
ing establishments the greater the time spent in formal, off-the-job training, the 
higher the establishment’s productivity. For nonmanufacturing employers the 
content of training has a similar impact on an establishment’s productivity. Com- 
puter skills development, even when the results are controlled for industry, has a 
positive impact on productivity, leading Lynch and Black (1996a:25) to conclude 
that “it is not so much whether you train your workers but rather in what you train 
them that affects establishment productivity.” 

What Lynch and Black’s analysis clearly suggests is that the underlying 
fundamentals of the system are sound: workers acquire skills in which employers 
invest through further training and education because to do so increases establish- 
ment productivity. 

The problem, then, lies elsewhere, not in the current functioning of the 
system but in the likelihood that it will not be able to sustain itself. As docu- 
mented through our focus groups and reported in the EQW National Employer 
Survey, employers have little or no faith in the capacity of schools to either 
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provide or certify the skills on which the productivity of their enterprises depend. 
The EQW survey question that best highlights this disconnection between schools 
and employers asked employers how important the following attributes are in the 
decision to hire a new nonsupervisory or production worker: applicant’s previ- 
ous work experience, previous employer’s recommendation, years of schooling, 
grades, teacher’s recommendations, current employer’s recommendation, reputa- 
tion of applicant’s school, applicant’s attitude, applicant’s communication skills, 
score on an employer-administered test, and industry-based credentials. Respon- 
dents ranked each attribute on a scale of 1 (not important) to 5 (very important). 
Four of the five bottom-rated attributes related to schools and schooling. Teacher 
recommendations came in dead last, and the fifth attribute of this set — industry- 
based credentials — may also reflect a bias against schools, since they are often 
the ones to provide both the training and the tests for these credentials (see Table 
3-6). 

It is the sense that “school doesn’t matter” that bothers educators concerned 
with the contribution that education ought to make to the quality of the work 
force. Tell young people that school doesn’t matter— and it won’t! Expect, as a 
result, the conclusion that Albert Shanker, president of the American Federation 
of Teachers, drew when commenting on the findings presented in the EQW 
National Employer Survey: “It’s obvious that the less attention employers pay to 
school performance, the less incentive kids have to achieve and the more poorly 
prepared they will be” (Shanker, 1995:E9). This self-fulfilling prophecy both 
disenfranchises the nation’s noncollege-bound students and threatens to under- 
mine education’s contribution to productivity in the economy — unless other 
means are found to teach skills and instill discipline. 

Intrigued by these results and troubled by their implications, the National 



TABLE 3-6 Relative Ranking of Factors in Making Hiring Decisions 



Applicant’s Characteristics Rank" 

Attitude 4 6 

Communication skills 4 2 

Previous work experience 4 0 

Recommendations from current employer 3,4 

Previous employer recommendation 3.4 

Industry-based credentials (certifying applicant’s skills) 3.2 

Years of schooling 2 9 

Score on tests administered as part of the interview 2.5 

Academic performance (grades) 2.5 

Experience or reputation of applicant’s school 2.4 

Teacher recommendations 2 1 



0 1 = not important or considered; 5 = very important. 

NOTE: Data derived from Question 57 on the EQW National Employers Survey: “When you 
consider hiring a new nonsupervisory or production worker (frontline worker), how important are the 
following in your decision to hire?” 
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School-to-Work Office asked whether the EQW National Employer Survey could 
similarly document other opportunities and/or costs associated with employers’ 
decisions to use — or not use — school measurements to screen job applicants. Do 
employers who use grades and school reputations when screening applicants or 
have students on their work sites incur lower recruiting costs? Are these employ- 
ers more likely to invest in the training of these first-time workers during their 
first year of employment? 

The answer to the first question turns out to be “no.” If anything, the 
relatively small proportion of employers who use school measures when deciding 
whom to hire spend a higher proportion of their annual labor costs on the recruit- 
ment and selection of new employees — in retrospect, not an altogether unex- 
pected finding. Using information from our focus groups with employers, how- 
ever, we altered course. Many of these employers reported that they did not 
screen new hires, but instead “tried them out” — often resulting in a series of hires 
and fires until both employer and employee found a suitable match. What this 
trial-and-error approach to hiring suggests is that both direct and indirect recruit- 
ing costs are incurred by employers who do not use school measures to screen 
new hires — and that higher turnover rates for new frontline employees during 
their first year of employment might serve as one measure of indirect recruitment 
costs. 

To test this hypothesis, we developed a logit model using as its dependent 
variable a Boolean value that split the sample into two categories: establishments 
with 10 percent or more of their work force with less than 1 year of tenure and 
establishments with less than 10 percent of their work force with less than 1 year 
of tenure. We controlled for the effect of both upsizing and downsizing, as well 
as for the size of the establishment and its industry using two-digit standard 
industrial classification codes. We also combined employers’ ratings of the three 
schooling-based screens — grades, school reputation, and teachers’ recommenda- 
tions — into a single schooling-measures index (Zemsky et al., 1996). 

The logit analysis yielded compelling results for both the manufacturing and 
nonmanufacturing sectors (see Tables 3-7 and 3-8). The models identify a sig- 
nificant negative relationship between school screening variables and low job 
tenure. Both manufacturing and nonmanufacturing establishments that use school 
measures as important criteria when screening and hiring new workers report, on 
average, fewer workers with 1 year or less of tenure. In addition, both manufac- 
turing and nonmanufacturing establishments that offer tuition reimbursement 
have higher tenure. 

We used the same statistical strategy to explore whether employers who use 
school measures when screening and hiring frontline workers are more likely to 
invest in the training of these new workers. In the logit models for formal 
training, the dependent variable was whether or not an establishment spends 
more or less than the median on training new nonsupervisory workers. We 
included as independent variables remedial skills training, tuition reimburse- 
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SKILLS AND THE ECONOMY 



ment, and new-hire orientation in order to control for any effects on the outcome 
variable produced by these activities. Our interest was to examine whether using 
schooling criteria to screen potential employees is related to the employer’s 
investment in substantive add-on training for new hires during their first year of 
employment— not training that initiates new employees, remedies deficits in ba- 
sic skills, or reflects an employee’s decision to continue his or her formal, school- 
based education. 

The logit model for the manufacturing sector indicates that establishments 
scoring high on the school-measures variable spend more on the training of new 
nonsupervisory workers (see Table 3-9). However, in the logistic model for the 
nonmanufacturing sector, the relationship between the school-measures index 
and training investment in new workers is positive but not significant. (See Table 
3-10.) In addition, if the skill requirements to perform production and support 
jobs at an acceptable level have increased, these establishments also invest more 
in new-worker training. As in the manufacturing sector, establishments that offer 
more formal training on remedial skills and offer new-hire orientation also invest 
more in new-worker training. 

Taken in conjunction with earlier findings derived from the EQW National 
Employer Survey, the results of our analysis for the National School-to-Work 
Office suggest the existence of a kind of education and training nexus. That is, by 
and large it is the same set of establishments that use school measures to screen 
job applicants, that invest in the initial training of new employees, that provide 
tuition benefits so employees can enroll in work-related courses outside the firm, 
that report increased skill requirements for their jobs, and that are more likely to 
have nonmanagers and nonsupervisors using computers. 



MAKING SENSE OF THE JUMBLE 

What these results also suggest is that schools and the skills they teach are 
important — that for some employers a reliance on schools to train and certify 
skilled workers creates a competitive advantage — but that most employers now 
seek skilled workers elsewhere. Two stories from our focus groups and inter- 
views with employers bracket the issue. Not surprisingly, during these sessions, 
school systems in general and high schools in particular were subject to the same 
kind of battering that youth received. There were stories of high schools that 
could not or would not respond to employers, that did not know how to work with 
businesses, that were dismissive of students who did not want to go to college, 
that used their vocational programs as dumping grounds, and that misled their 
students by not stressing that holding on to a job was serious business. When 
hiring a young worker, most employers did not bother asking for a high school 
transcript, simply because they “wouldn’t believe what the school was telling 
us. After more than 20 minutes of this sustained bashing, the human resources 
manager of a middle-sized manufacturing concern called the conversation to a 
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halt, observing: “I am not a great fan of our local high schools. But what I want 
in a new worker no high school can supply — a 26 year old with three previous 
employers.” 

In interviews with employers we frequently ask: “Exactly what do you want 
schools and colleges to produce? What are the critical skills you want them to 
have?” For the most part these are questions that employers cannot answer, 
queries that somehow seem wholly disconnected from the reality of running a 
business and hiring a work force. We are met with either a kind of embarrassed 
silence or a short awkward speech about the importance of standards as well as 
skills. However, one manager of a service bureau in which most workers were 
required to master computerized systems knew what he was looking for: some- 
one who could read a manual and get started; someone who would not bluff, who 
would not be afraid to ask a question when he or she should; and, finally, some- 
one with sufficient communication skills and respect for his or her elders to be 
able to go down the hall “and ask old John how it’s done.” 

What these anecdotes and data from the EQW National Employer Survey 
suggest is that the skills most employers want are the ability to complete tasks, to 
get the job done, and to be both self-motivated and trainable — in sum, to be a 
truly good learner. A minority of establishments still believe success in school 
certifies the presence of such skills. Most employers, not sharing this faith, 
would rather trust trial-and-error hiring of the young, reserving their best jobs for 
those who have successfully held a series of positions. School credentials are not 
important, but evidence that an applicant has successfully acquired job survival 
skills is. 

When the members of EQW’s National Advisory Board— all of whom have 
been chief executive officers of large enterprises — reviewed the evidence pre- 
sented here, they recalled an earlier EQW study conducted by Joan Wills of the 
Institute for Educational Leadership and Irene Lynn of the U.S. Department of 
Labor (Lynn and Wills, 1994). Their study included a survey of firms that 
participated in work-based learning programs, such as apprenticeships and in- 
ternships. Among employers participating in these programs there was a well- 
spring of support for both the initiatives and the quality of the young workers they 
attracted. Most participating firms found their students to be productive and 
contributing employees. Although they often echoed the complaints of other 
employers about the high schools with which they worked — citing that too often 
the participating schools were not sufficiently organized or did not attach high 
priority to the program — a clear majority of employers also reported that they 
would take additional students later and would recommend the programs to other 
small-business owners. # 

Such internships — whether for pay or credit — bring students into the world 
of work and into the kinds of plants, offices, stores, and service agencies where 
they are likely to spend their working lives. Internships have the added advan- 
tage of creating an informal effective communication channel through which 
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employers learn about schools and their students and through which schools learn 
about the needs and practices of employers. 

Adopting the employer’s perspective, I would refocus the Board on Testing 
and Assessment’s interest in ‘The Knowledge Gap: Rhetoric vs. Evidence” (the 
title of a session at the board s March 1996 conference where this paper was first 
presented). I would expect the research community to certify that skills matter, 
principally by citing both the growing gap in wages between educated and unedu- 
cated workers and the contribution that years of schooling make to establishment 
productivity. I would then call attention to a different kind of “knowledge gap,” 
the one that too often leads schools to claim that they “know best” and employers 
to discount what schools can in fact supply. 

The conclusion that the EQW National Advisory Board reached was that, 
more important than further research on the functioning of the youth labor mar- 
ket, there is a need for increased contact between schools and employers — the 
kind of contact that only effective internship programs can supply. What em- 
ployers need to know is which schools are the best suppliers of good workers. 
What schools need to know is what kinds of experiences their graduates are 
having in the workplace. In moving regularly between school and work, success- 
ful interns provide practical answers to both sets of questions. 

What is envisioned is not so much a formal finding about whether or not a 
skills gap exists but rather a mechanism — a feedback loop, really — that allows 
both schools and employers to adjust continuously to the changing demand for 
skills in an increasingly complex and competitive economic environment. 
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Should Social Skills Be in the 
Vocational Curriculum? Evidence from the 
Automotive Repair Field 



Bonalyn Nelsen 



INTRODUCTION 

At the turn of the century it was common for wealthy families to enroll their 
daughters in institutions known as finishing schools. Although these institutions 
were far from progressive or enlightened by today’s standards, they served what 
was then a socially valued purpose: imparting the social skills that would ease a 
young woman’s entry into the adult role she would soon occupy. Of course, the 
roles of women in such families were quite different from women’s roles today; 
apart from managing household servants, the chief occupation of such women 
consisted of entertaining and being entertained. Therefore, students were drilled 
in etiquette, connoisseurship, voice and music, the art of making lively and enter- 
taining conversation, and other skills required by female members of genteel 
society. Through concerted practice in realistic settings, students gradually ac- 
quired the ability to adapt their behavior to various social settings and to project 
the image of grace and poise that was the hallmark of an accomplished wife and 
hostess (McBride, 1992). 

Today, finishing schools and their unique brand of training are found only in 
the pages of history books. Two factors contributed to their demise. First, the 
roles for which they prepared young women no longer exist. It is now customary 
to prepare all young people for active, productive roles in the work force without 
regard to gender, race, or social class. Second, society’s views on the importance 
of social skills and knowledge have undergone considerable revision. Although 
few parents and teachers would discount these skills entirely, the social capital 
imparted by finishing schools is generally considered to be far less important than 
the intellectual capital imparted by schools — basic literacy, numeracy, writing 
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skills, and the like. When the perceived importance of role-specific social skills 
diminished, the need for structured opportunities devoted to imparting these skills 
evaporated, and the finishing schools disappeared. 

But it may be time to reconsider the importance of social capital in general 
and social training in particular. Since the 1980s, researchers have penned count- 
less reports and articles bemoaning the poor performance of recent high school 
graduates in the workplace (e.g., see National Commission for Excellence in 
Education, 1983; Gorman, 1988; Carnevale et al., 1988; Aerospace Education 
Foundation, 1989). Although the problem is commonly attributed to a lack of 
academic skills, recent evidence suggests it may be at least partly social in nature. 
Employers surveyed about their hiring preferences consistently rank a good atti- 
tude and the ability to adapt to work environments as more important than educa- 
tional credentials (Barton, 1990). Many also report difficulty in finding young 
people who exhibit a desirable mix of behaviors and attitudes (Barton, 1990; 
Committee for Economic Development, 1984). It is hardly surprising, then, that 
employers are far more likely to dismiss employees for difficulties in adapting to 
the work environment than for failure to learn job skills (National Association of 
Manufacturers, 1990; Committee for Economic Development, 1991; Cappelli, 
1995 ). This evidence has prompted at least one researcher to ask if the so-called 
skills gap is due to a deficit of prosocial attitudes and behaviors (see Cappelli, 
1995). 

It is important to consider this possibility, for if the skills gap can be partly 
attributed to a lack of social skills, simply reinforcing basic literacy and numeracy 
will be insufficient to improve the work performance of high school graduates. 
This essay takes up the idea that the poor performance of recent high school 
graduates may indeed be partly social in nature. However, I argue that the 
problem is rooted not only in a lack of generally useful attitudes and behaviors 
like responsibility and punctuality, as Cappelli (1995) suggests, but also in a 
deficit of the occupationally specific social skills and knowledge needed to thrive 
in today’s workplace — precisely the type of social capital once imparted by fin- 
ishing schools. But what is social capital, and why is it in short supply? 

ROLE OF SOCIAL CAPITAL IN THE WORKPLACE 

All social groups possess a set of cultural rules and norms that guide the 
behavior of members. Persons who aspire to membership must learn to identify 
and comply with those rules (Gerholm, 1990). Social capital consists of the skills 
and knowledge required to evaluate and respond to situational demands in social 
settings. It provides individuals with the ability to “fit in” or gain acceptance to 
social groups over time by appreciating the cultural rules and norms governing 
any given situation and adapting their behavior to comply with those rules. This 
ability is critical because individuals who experience difficulty in perceiving and 
adapting to cultural rules risk being labeled outsiders. As a rule, those who hold 
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this marginal status receive fewer benefits. In work groups, benefits consist of 
favors, indulgence, offers of assistance, and, perhaps most important, access to 
the informal knowledge required for practice. 

Broadly speaking, two types of knowledge are applied in work activities: 
formal and informal. Formal knowledge consists of facts, principles, theories, 
algorithms, and other abstract systematic forms of knowledge. It is usually 
explicit and decontextualized — characteristics that render this knowledge easily 
codifiable (Brown and Duguid, 1991). Hence, formal knowledge is found in 
manuals, protocols, computer programs, and various textual resources present in 
the workplace. Informal knowledge consists of heuristics, work styles, and other 
situated understandings about materials, tools, and techniques (Barley, 1985; 
Barley and Nelsen, 1995). It is largely tacit, embedded in activity, and tied to the 
particulars of work in a given setting. Because informal knowledge is seldom 
articulated and somewhat variable, it is rarely written down. Instead, the under- 
standings that make up informal knowledge are lodged in the collective memory 
and work practices of the local community of practice. 

The skills and knowledge required to obtain informal knowledge will be very 
different from those used to gain formal knowledge. To access formal knowl- 
edge, one has but to obtain the manual or program in which the knowledge is 
stored and find the needed information within. These resources are typically an 
“unrestricted good” provided by the employer and freely available to all employ- 
ees. Indeed, newly hired workers can expect to receive numerous policy manuals 
and handbooks upon arrival at their new jobs. Manuals and textbooks are on 
hand for all who need them. Software is installed in workstations frequented by 
many employees. Thus, any worker with the ability to read and open a computer 
icon can acquire formal knowledge on the job. But informal knowledge is not an 
unrestricted good possessed by the employer and freely shared with all. Rather, 
it is the intellectual property of the community of practice in a given work setting. 
To access this information, new hires must successfully insert themselves into the 
community of practice and become an accepted member. 

Social capital is vital on both accounts. Individuals with a deficit of social 
skills may never have the opportunity to acquire informal knowledge, for some 
degree of cultural proficiency is necessary to be hired in the first place. Social 
competence is often taken as an indicator of intellectual competence and techni- 
cal ability (Gerholm, 1990). If job candidates behave awkwardly or inappropri- 
ately during an interview, employers may interpret their behavior as a sign of 
general incompetence. Thus, even talented, well-trained students can experience 
difficulty in the job market if they are unable to demonstrate a reasonable amount 
of social acuity during a job interview (Sternberg, 1993). 

Social capital is just as important after a neophyte’s arrival on the job. In 
fact, the quality of a new hire’s informal education depends largely on his or her 
ability to create an impression suggestive of competency and sociability. Most 
informal knowledge is transmitted spontaneously, usually as relevant problems 
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are encountered in the course of work activities, and is passed among workers in 
the form of bits of advice, stories, demonstrations, and brief instances of guided 
practice (e.g., see Barley and Bechky, 1994). One must be an “insider” to be 
actively included in such exchanges. Moreover, frequent contact between neo- 
phytes and experienced workers increases the likelihood that informal under- 
standings will be passed (Gerholm, 1990). Communities of practice are inher- 
ently practical; members are less likely to invest time and effort in tutoring 
neophytes who appear to be technically or socially inept. Thus, neophytes who 
display considerable social prowess are more likely to enjoy the company of 
peers and, consequently, to receive more opportunities for informal instruction 
than those perceived as social misfits. 

A lack of social acuity would not be problematic but for the fact that success- 
ful work practice hinges on mastery of informal knowledge. Although so-called 
unskilled and semiskilled workers have always relied almost exclusively on such 
knowledge (Kusterer, 1978), workers with considerable formal training also make 
extensive use of informal understandings. For example, technicians and tech- 
nologists employed in fields where postsecondary education is either mandatory 
or customary claim that formal knowledge is far less important than the informal 
knowledge gained through experience and participation in the local community 
of practice (Barley, 1985; Barley and Nelsen, 1995). Professionals also report 
that much, if not most, of the learning central to their work took place after they 
completed formal studies and immersed themselves in work activities (Schon, 
1983; Wagner, 1987; Wagner and Sternberg, 1985). In short, it appears that 
social capital and the ability to fit in are crucial to any young person’s success on 
the job. 



Developing Social Acuity for Work 

Unfortunately, most students have few opportunities to develop this abil- 
ity before being thrust into situations where they are expected to exhibit it. 
Schools do a fair job of inculcating reading skills, mathematical knowledge, 
and other forms of intellectual capital, but they can be poor places in which to 
become socially adept. This is because schools may fail to replicate the social 
environment found in the workplace, to impart social capital useful in the 
workplace, and to provide structured opportunities for learning and practicing 
social skills. 



Replication of the Work Environment 

Developing social capital requires familiarity with the social dynamics ex- 
tant in the workplace. To impart such knowledge, schools must faithfully repli- 
cate the social environment found in work settings by creating situations that 
mimic those found in the workplace and populating them with actors found in 
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such situations. Interaction with experienced practitioners, employers, consum- 
ers, suppliers, and other parties should take place under conditions similar to 
those found in the workplace and engender similar consequences. Students 
should be placed in a role like the one they will assume on the job and should 
have occasion to sample both the freedoms and the limitations inherent in that 
position. 

Most schools and vocational training programs fail to provide these condi- 
tions. Because few consumers, employers, or other parties encountered in the 
workplace frequent schools with regularity, students have limited opportunities 
for interaction. The pressures and consequences of the interaction they do expe- 
rience in school environments may be quite different from those found in work 
environments. Teachers and classmates may, for example, be far more tolerant of 
social nonconformity than employers and experienced workers. Aberrant behav- 
ior that garners a reprimand from a teacher or a trip to the principal’s office can be 
grounds for immediate dismissal in work settings. And the role students occupy 
in the classroom may be quite unlike those in the workplace, although these may 
overlap for a short time. As a result, schools often do a poor job of providing the 
cultural backdrop against which social capital is acquired. 



Congruence of Social Capital 

The deficit of occupationally specific capital can be traced to another charac- 
teristic of school environments. Simply put, schools frequently pursue their own 
agendas by imparting social skills useful in schools— not the workplace. In his 
seminal study of socialization in the classroom, Philip Jackson (1968) noted that 
students are subjected to a “hidden curriculum” that implicitly inculcates social 
skills that make them more manageable in the classroom. Through judicious 
distribution of rewards and punishments, teachers encourage students to be pa- 
tient and submissive, passive and quiet, and not to come readily to the aid of peers 
as such activity is labeled “cheating.” 

Although this sort of social capital undoubtedly makes students more trac- 
table, it may do little to improve their chances of learning on the job. In fact, 
studies of socialization and learning in the workplace suggest that the social 
capital acquired in schools may actually hinder informal learning on the job. 
Both Becker (1972) and Kusterer (1978) noted that employers seldom assign 
formal responsibility for teaching newcomers how to perform their duties. Con- 
sequently, apprentices and new hires must assume responsibility for their own 
informal education by continually seeking opportunities for learning on the job. 
Individuals who are passive and submissive risk being overlooked or perpetually 
stuck with menial, unpleasant chores that offer few opportunities for acquiring 
new skills and knowledge (Barley and Nelsen, 1995). Even assertive newcomers 
will probably enjoy limited tutoring if they ignore norms of reciprocity governing 
exchanges of assistance and information for long. 
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Structured Opportunities for Learning and Practice 

A few learning environments do meet the requirements outlined above. Craft 
apprenticeships, residencies in teaching hospitals, and the training of doctoral can- 
didates in academic departments expose students to the social dynamics of the 
workplace, mainly because the learning and work environments are one and the 
same. However, even students in these exemplary settings may fail to acquire 
social capital if no deliberate efforts are made to impart it. For example, Gerholm 
(1990:263) has noted that academic departments make little deliberate effort to 
teach graduate students “the rules of the game” or to impress upon them the impor- 
tance of learning cultural rules and norms, despite the fact that such knowledge 
profoundly affects the quality of their education and, eventually, their careers (see 
also Sternberg, 1993). Instead, students must pick up these implicit understandings 
on their own through interactions with teachers, peers, and staff members. This 
process becomes an informal sorting mechanism in academic departments: stu- 
dents who catch on readily become ensconced in the departmental community and 
enjoy enhanced opportunities for learning while those exhibiting less social acuity 
are branded outsiders and consequently enjoy fewer opportunities. 

Although this Darwinian logic effectively selects out students who innately 
lack social ability (and who are consequently poor candidates for membership in 
the academic community), it may also have the unfortunate effect of excluding 
those who suffer a surmountable handicap in this area. One can reasonably 
expect students whose racial, ethnic, or class backgrounds or other characteristics 
differ from those predominating in the departmental community (and, by exten- 
sion, the workplace) to experience some difficulty in picking up the cultural rules 
and norms that guide behavior in school and work settings. However, in the 
absence of explicit attempts to inculcate social capital to all, the cultural playing 
field may not be level. 



The Importance of Social Capital 

In sum, the idea of providing students with structured opportunities for ac- 
quiring occupationally specific social capital retains considerable merit even in 
today’s more enlightened and productive age. These understandings are at least 
as important to success on the job as basic and technical skills. Yet most schools 
offer few opportunities to acquire them. Quite simply, schools are not work- 
places. Hence, most are either unwilling or unable to provide the situations and 
settings that students will experience upon entering the work force. Even schools 
that faithfully replicate actual work settings seldom make deliberate attempts to 
impart these understandings. This implies that opportunities for acquiring social 
capital are haphazard at best and nonexistent at worst. It is little wonder, then, 
that employers are increasingly dissatisfied with the quality of social skills pos- 
sessed by recent high school graduates. 
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An Alternative Model of Social Education 



Obviously, reversing the deficit of social skills will require a search for 
alternatives to existing models of social education in the classroom. The finish- 
ing school represents one such model. These were institutions devoted to impart- 
ing the social capital required to ease young people into adult roles and help them 
become productive members of society. Because they were boarding schools, 
students were immersed in the social settings and roles they would soon occupy. 
Students were swept up in a dizzying round of balls, dinners, parties, and outings, 
all of which provided occasions for experiencing social dynamics in realistic 
settings. These activities were supplemented with formal instruction in social 
skills and structured opportunities for practice. Parlors and gardens became 
laboratories in which young women honed the social skills they would need for 
public life. Needless to say, because the schools existed expressly for imparting 
social capital, the skills and knowledge taught were congruent with those needed 
in the “workplace.” These features made finishing schools highly effective ve- 
hicles for imparting the unique type of social capital required by the social elite. 

I believe that today’s students could benefit greatly from the type of instruc- 
tion formerly provided by these schools. Of course, the modern-day “finishing 
school” would bear little resemblance to its forerunner in either form or content. 
For example, to maximize efficiency and comply with modem educational prac- 
tices, instruction would take place within existing vocational training programs 
rather than boarding schools devoted solely to that purpose. “Laboratories” 
would consist of offices, sales counters, examination rooms, and shop floors 
rather than dress balls and tea parties. And the curricula would include strategies 
for handling difficult customers, reporting problems to the boss, or seeking the 
advice of experienced peers rather than being a gracious hostess. However, the 
purpose of the lessons would remain essentially the same: first, and perhaps most 
importantly, to sensitize students to the importance of social dynamics in the 
workplace; second, to make them familiar with the cultural rules of the occupa- 
tion for which they are preparing; third, to note how these rules may vary across 
work settings; fourth, to acquaint students with the occupational roles they will 
soon occupy; and, finally, to tutor them in a variety of appropriate responses to 
social situations they will soon experience and to provide opportunities for 
practice. 

None of these lessons are possible without a detailed knowledge of the 
cultural rules and norms observed in the occupation in question. Finishing schools 
owed their success largely to an impressive understanding of the social capital 
needed by women in upper-class households. This knowledge allowed the insti- 
tutions to create a representative sample of social settings in which to learn and 
practice. In fact, the facilities themselves were carefully designed to create a 
physical and social atmosphere that faithfully mimicked those the students would 
enjoy upon graduation (McBride, 1992). Similarly, any discussion of modern- 
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day “finishing schools” or formal social instruction must start with the develop- 
ment of a detailed understanding of the social capital needed by newcomers in a 
given occupational milieu. To this end, I will consider the example of automo- 
tive repair. 

By drawing on data from an ethnographic study of auto repair, I will examine 
the sort of social capital required by workers in actual work settings. Auto repair 
is a field not renowned for social aplomb; automotive technicians would seem to 
be unlikely candidates for finishing schools. Yet, as I will show, social skills are 
of vital importance to the success of practitioners in this occupation. These data 
will be used to fashion a typology of social skills and knowledge required to ease 
entry-level automotive technicians into full-fledged occupational roles. Although 
by no means exhaustive, this typology offers a representative description of the 
types of social capital useful for gaining acceptance in work settings. The essay 
will conclude with a discussion of how this knowledge could be used to create 
opportunities for acquiring social capital useful in this occupational milieu. 

DATA AND METHODS 

Automotive repair is a field that offers a wide variety of services and service 
delivery formats. 1 To develop a more comprehensive understanding of these 
formats and their social dynamics, I chose to study two firms featuring highly 
contrasting models of service delivery. 

The first firm was an independently owned dealership that sold and serviced 
the full line of vehicles produced by a U.S. automotive manufacturer. This was a 
high-volume shop offering a full range of maintenance and repair services. Most of 
the repair shop’s business consisted of routine maintenance and warranty repair 
work on the product line featured by the dealership, although other work was 
willingly accepted. The shop’s 16 technicians were assigned to one or more tech- 
nical specialties (e.g., brakes, transmissions, tune-ups, and electrical system). Two 
of these technicians had been in the field for less than 2 years and, hence, held an 
apprentice-like status in the local community of practice. One other technician had 
worked in the field for less than 3 years. The remainder of the technical staff had 
considerable tenure, with the most senior employee logging 24 years with the 
dealership. In addition, the shop employed four predelivery inspection attendants 
to vacuum, clean, and prepare vehicles for delivery to clients; a parts-room atten- 
dant responsible for ordering and maintaining stock; five service advisers who 
handled customer service duties and paperwork; and three clerical employees. 
Managerial responsibilities were divided between two positions: a shop manager, 
who took responsibility for technician’s work, and a service manager, who super- 
vised the remaining staff and overall service operations. 

*A service format represents an organizational template for service delivery in the after-market 
automotive repair industry (Mateyka et a!., 1988). Five formats are dominant: speciality repair, 
mass merchandisers, independent repair shops, full-service gas stations, and new car dealerships. 
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The second research setting was a small, independently owned repair shop. 
Unlike the dealership, this shop provided only automotive maintenance and re- 
pair services. The owner was a technician who worked alongside the two techni- 
cians he employed in the shop’s three service bays. Although he had been in the 
industry for 18 years and had owned his own shop for 6, his employees had only 
3 and 5 years of experience, respectively. Both had been employed at the shop 
for approximately 3 years. The owner’s spouse handled most of the clerical and 
administrative duties. The owner and his technicians were “bumper-to-bumper 
mechanics,” who prided themselves on their general knowledge of automotive 
technology and ability to tackle most repairs. Most repair work was performed 
on site, although work requiring tools not owned by the shop, such as precision 
welding or grinding, was dispatched to various specialty shops in the vicinity. 

My methods of data collection were identical for both research sites. I 
moved freely about the shop, spending much time observing how the technicians 
worked and interacted with others in their work area. I also observed activities in 
other areas, such as the detailing area, vehicle drop-off area, parts room, customer 
waiting areas, and parking lots. In each location, both workers and customers 
were encouraged to speak freely about their past and present activities and inter- 
actions. I observed activity at the dealership for 5 days per week for 6 to 1 0 hours 
a day. Observations at the independent shop were more sporadic, consisting of 4- 
to 8-hour periods once or twice each week. In total I logged 100 and 75 hours of 
observation, respectively, at the dealership and the independent shop. I jotted 
down field notes throughout the day and expanded them off site each evening 
while memories were still fresh. 

These observations provided an invaluable opportunity to witness firsthand 
the social dynamics of the workplace: the exchange of information and assis- 
tance, the socialization of employees, the forging of alliances, the enactment and 
violation of cultural rules and norms. These observations were supplemented by 
detailed taped interviews conducted with 18 technicians, shop owners, and ser- 
vice managers employed in other auto repair shops. In addition to other topics, 
technicians were encouraged to offer detailed accounts of their early experiences 
on the job. Particular attention was paid to instances in which technicians had 
committed social gaffes and the lessons they learned as a result. Questioning also 
focused on strategies they successfully employed to win the acceptance of peers 
and avoid attributions of incompetence (namely, “looking stupid”). Shop owners 
and service managers were encouraged to describe their expectations for entry- 
level automotive technicians and to recount examples of behavior that met, ex- 
ceeded, or fell short of their expectations. 

These data were analyzed with an iterative process of coding and hypothesis 
formation. The first wave of coding identified various types of social capital used 
in the workplace: knowledge useful for exchanges of assistance; for accessing, 
disseminating, and evaluating informal knowledge; and so on. Subsequent analy- 
sis was devoted to elaborating these categories to fashion a typology of social 
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capital useful to entry-level automotive technicians. It is to this typology that I 
now turn. 



FITTING IN AND GETTING BY: SOCIAL CAPITAL 
IN AUTO REPAIR 

Although repair shop owners, service managers, and technicians expressed 
slightly different opinions about what skills and abilities were required by entry- 
level automotive technicians, all agreed that two types of competencies are indis- 
pensable. The first consists of basic and technical skills. Entry-level technicians 
should have the ability to read, write, and perform basic arithmetic and should 
have a firm grasp of relevant technical skills: a knowledge of safety and tool use; 
a basic understanding of the function of automotive systems, their components, 
and repair procedures; the ability to perform visual inspections; and a familiarity 
with manual usage. The second type of competency is social. This is manifest in 
the ability to fit into the shop surroundings: to get along with co-workers and 
management, to communicate effectively, to impress clients with their competent 
and professional manner. 

Neophytes could ill afford a serious deficiency in either area. Entry-level 
automotive technicians were subjected to close scrutiny before and after their 
arrival on the job. Opinions about the new hires’ technical and social compe- 
tency were quickly formed in the workplace and, once made, were not easily 
shifted. It is customary for all new hires to serve a 60- or 90-day probationary 
period. However, informants reported that dismissal within a week or two of 
hiring was common if new hires showed signs of faltering. 2 Although these 
practices may seem slightly Draconian, informants offered numerous justifica- 
tions for their actions. Owners and service managers noted that botched repairs 
could result in thousands of dollars’ worth of damage and life-threatening 
hazards — liabilities that no shop could afford. Disrespectful or curt treatment 
could produce a disgruntled customer and result in lost profits as surely as 
technical mishaps. Also, skilled technicians were highly sought after and, once 
found, were enticed to remain. Thus, many shops featured close-knit groups of 
technicians of long tenure. If new hires appeared unwilling or unable to adapt 
their behavior to the shop’s existing social structure, they would quickly be 
shown the door. Finally, some shops invest considerable funds in training their 
technicians; shop owners and managers want to expend these funds wisely by 



2 The use of assistants or teams was more prevalent in speciality repair shops, such as those that 
provided precision grinding and machining services or that rebuilt transmissions. In such shops, 
assistants would be employed to remove and install engines and transmissions, while technicians 
were charged with diagnosing and repairing the units. Dealerships also made occasional use of 
apprentices or assistants in this way. But for the most part, technicians work on a wholly indepen- 
dent basis. 
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retaining only those candidates who seem to be good prospects for long-term 
employment. 

The opinions rendered by experienced technicians could be just as swift and 
final. Experienced technicians realized that virtually all entry-level technicians 
would require a good deal of assistance and guidance to succeed on the job. 
However, they saw little point in investing time and effort in cultivating neo- 
phytes who showed scant promise, particularly when they knew such workers 
seldom stay long. Hence, individuals whose work or behavior displayed disre- 
gard for either technical standards or the rules and norms valued by practitioners 
were soon identified, avoided, and left to fend for themselves. “There are a lot of 
fish in the sea,” noted one technician, “but only a few are keepers. As far as I’m 
concerned, the rest can work somewhere else.” The implications of these views 
are clear — entry-level automotive technicians can greatly enhance their success 
on the job by understanding and exhibiting social capital. An informed and 
realistic view of expectations regarding their performance allows neophytes to 
more easily meet the behavioral requirements of the workplace. It also allows 
them to identify social pitfalls before they succumb. Both are central to avoiding 
attributions of incompetence and to winning acceptance among employers, man- 
agers, and fellow workers. The salient types of social capital are discussed 
below. 



The acceptance of an entry-level technician hinges largely on the ability to 
display an attitude that simultaneously projects an air of confidence and one of 
humility (Nelsen and Barley, 1994). Entry-level technicians must convince cli- 
ents of their ability, persuade superiors of their worth as an employee, and assure 
experienced peers that they are worthy of help and instruction. Evincing an air of 
aplomb is necessary on all accounts. In interactions with customers, confidence 
is reflected in how technicians present themselves and their work: 

It’s important that the technician projects a certain confidence in his abilities. 

That means not guessing, not going before the customer and saying, “Well, I'm 
not sure what it could be . . . could be this or could be this . . Instead, he 
should say, “We’re going to find out what we need to fix. This is what I’m 
going to do to find that out.” You have to understand that diagnosing some of 
these problems today can take up to 2 hours, and that’s a lot for the customer to 
pay for. So they want to know that the technician knows what he's looking for, 
that he knows what he’s doing. ( service manager , dealership) 

In the shop, confidence is manifested in a willingness to tackle unfamiliar, 
unusual, and, eventually, complex tasks. Although entry-level technicians were 
expected to display a certain amount of hesitation or self-doubt, this behavior was 
expected to be quickly replaced with an air of determination and poise as experi- 
ence grew. Trepidation expressed at confronting a task for the first time was 
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indulged, particularly if the repair was particularly complex or unusual. But 
neophytes were expected to overcome their reluctance after their second or third 
encounter. The abilities of those who disregarded this norm by continually 
expressing self-doubt became suspect. 

Humility is also necessary for successful role performance; this attitudinal 
characteristic is evident in a willingness to admit mistakes or puzzlement, to ask 
questions, and to seek the counsel of knowledgeable peers and managers. In a 
purely instrumental sense, these behaviors are necessary to signal a need for help 
and advice and to avoid attributions of incompetence. Experienced technicians 
and managers agreed that failure to make inquiries and to seek second opinions 
about diagnoses and procedures was a significant source of error and led to the 
formation of negative perceptions about neophytes’ promise: 

New guys get themselves into trouble because they don’t ask. There are always 
different ways of doing things, so test the waters by asking the boss. Let me 
make the decision. For example, if a customer asks for something that doesn’t 
sound right, like they don’t want to authorize work needed for safety reas- 
ons .. . that’s a potential liability to the shop. Well, let me decide how to handle 
the situation; don’t take on too much authority, {owner, independent shop) 

As the foregoing quotation suggests, humble behavior did more than signal a 
need for help and information. Expressions of humility signaled acknowledg- 
ment of an employer’s authority and experienced peers’ superior expertise and 
status in the community of practice. Thus, neophytes who failed to admit their 
ignorance or who failed to occasionally ask for assistance not only gave the 
impression that they were more expert than they really were, but also tacitly 
denigrated the accumulated skills and knowledge of experienced peers. As one 
subject noted, this was an impression that an entry-level automotive technician 
could ill afford: 

Car people like to tell you how much they know. “Oh, yeah, I know that; I’ve 
done that.” And that’s the absolute worst thing [entry-level technicians] can do. 

... If a new guy walks into a shop and tells [experienced technicians] how 
much he knows, who’s gonna be there to help him when he really needs help? 

Most of the technicians I’ve known have always been happy to help a new guy 
as long as the attitude was right. But as soon as you start tell in’ an old-timer 
how much you know, they’re gonna tum you off like a radio and just let you 
sink or swim. ( technician ; independent shop ) 



Adherence to a Work Style 

Adherence to a work style entails adopting a style of practice deemed crucial 
for avoiding the types of trouble that occur in a particular work context. A work 
style does not specify what procedures must be done but rather how procedures 
should be carried out. In auto repair it represents a collection of preemptive 
strategies and behaviors useful for outwitting the foibles of automotive technol- 
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ogy and for being efficient in a demanding, pressure-filled work environment. 
As automotive technology has become complex, diagnosis and repair are more 
difficult and time consuming. Yet, as competitive pressures and the cost of parts 
and labor increase, technicians are pressed to work faster and more efficiently. 
The competing demands of complex technology and efficiency increase the prob- 
ability that misdiagnosis and error will occur. Neophytes can greatly enhance 
their reputations among employers and peers by learning and demonstrating vari- 
ous behavioral strategies to cope with these pressures. 

Improvisation is one such strategy. Technicians were expected to become 
quite flexible and resourceful in adapting their practice to meet the exigencies of 
technology and time. Workers prided themselves on their innovation in the area 
of tool use, for example. A variety of household objects were substituted for 
costly tools and supplies — common petroleum jelly for white automotive grease; 
nail polish for marking paint; a humble paper clip for jumper wires; or, in cars 
featuring built-in diagnostic displays, a digital diagnostic scanner. Some prob- 
lems can be diagnosed only by recreating the physical states of operation under 
which they appear. For instance, when a thermistor or temperature-sensitive 
sensor is tested, the engine must be hot. Technicians regularly experimented with 
ways to fool the vehicle or component into activity without actually spending the 
time necessary to recreate physical states. Hence, rather than allowing an engine 
to idle for extended periods or taking a test drive, technicians would use a por- 
table hair dryer to trigger a thermistor. 

Tight tolerances and complex designs make modern automotive technolo- 
gies far less tolerant of contamination than those of the past. Contamination 
includes not only dirt and other contaminants accumulated during normal use but 
also matter introduced by the technician during repair procedures. The presence 
of even minute quantities of extraneous material can cause a component to fail. 
For instance, a stray metal filing trapped in a combustion chamber during reas- 
sembly will quickly pit and score the surface of pistons and cylinder walls. And 
lint from a shop rag used to clean parts of an automatic transmission prior to 
reassembly will block check valves and subsequently cause shifting problems. 
Cleanliness is therefore an important part of the technician's work style. Techni- 
cians took pains to carefully remove any foreign matter that might impede the 
vehicle’s operation and employed work practices known to reduce contamina- 
tion, such as using compressed air rather than a shop rag to dry parts of an 
automatic transmission. Cleaning habits demonstrated a concern for efficiency 
as well. When disassembling brakes, workers would place springs, calipers, and 
other components on shop rags and slide these beneath the vehicle before turning 
the rotors. Not only did this practice keep components free of dirt and stray metal 
filings, it also eliminated the need to wipe down each component separately 
before reassembly. 

Technicians saved both time and trouble by adopting an organized methodi- 
cal approach to their work. This was demonstrated in an exacting attention to 




85 



BONALYN NELSEN 



75 



detail. In one shop such concern was witnessed whenever an engine was pre- 
pared for removal from a vehicle. Before removing the engine, the technician 
dabbed the connections of vacuum hoses with nail polish of various colors and 
labeled wiring connectors with masking tape. Marking existing connections not 
only made the process of reconnecting hoses and wires much more efficient, it 
also decreased the frustrating possibility of making improper connections. A 
methodical approach was also manifest in a general concern for being organized 
and efficient. Technicians recommended placing the tools most frequently used 
on a small cart that could be wheeled from car to car as they worked, thus sparing 
them the trouble of making multiple trips to the tool box or searching about for 
tools. Parts were also kept organized and accounted for by storing them in 
labeled boxes prior to reassembly. 

Finally, the technicians’ preferred work style includes the ability to work 
independently and engage in self-directed practice. Automotive technicians sel- 
dom work as teams. Even very complex jobs, such as removing and rebuilding 
an engine, are accomplished by a single technician in most shops. 3 From their 
first day on the job, entry-level technicians also have a set of assigned tasks they 
are expected to accomplish independently of others. This was somewhat chal- 
lenging for neophytes, of course; their lack of experience and informal knowl- 
edge made frequent requests for help and guidance a practical necessity. How- 
ever, once advice or instruction was given, neophytes were expected to “run with 
it,” or apply it on their own, and gradually wean themselves from their peers’ 
assistance. 



Knowledge of Occupational Image 

All neophytes must develop an intuitive sense of the identity of their occupa- 
tion and its relations with other occupations (Gerholm, 1990) as well as an under- 
standing of how one should project and modify that image in various social 
situations. For entry-level automotive technicians, this required a general under- 
standing of norms governing demeanor, communication, and the manipulation of 
symbols. 

Demeanor 

A technician’s demeanor is reflected in bearing or conduct. Several charac- 
teristics were desirable, and not a few were considered injurious. Not surpris- 
ingly, friendliness and a cooperative nature were universally appreciated, as was 
the ability to take practical joking and teasing in stride. The technicians’ work- 



3 The National Institute for Automotive Service Excellence, a national nonprofit organization, tests 
and certifies the competency of automotive technicians. To become certified, technicians must pass 
written exams designed to test their technical knowledge. 
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day was filled with boisterous exchanges with peers, and neophytes were fre- 
quently targeted as the butt of a joke. Teasing relented gradually as neophytes 
were drawn closer into the community of practice. Hence, the joking and teasing 
were not unlike a sort of mild hazing intended to test neophytes’ demeanor and 
patience as they inched closer to membership status. Neophytes who became 
defensive or withdrawn upon receiving such attention were viewed as “bad sports” 
who were less-than-promising candidates. As one technician noted, an unpleas- 
ant demeanor was a flaw that was not easily overlooked in even talented 
neophytes: 

Being friendly, cooperative is important . . . especially for an entry-level me- 
chanic, because they're gonna be askin’ for favors every day. They have to be 
easy to get along with, too. Some of the new guys we get are a little frustrating 
for me to get along with. Like, here’s a person with good skills, they’re good 
with their hands. They have the physical ability and the mental aptitude for it 
but ... I don’t want to work with them. There’s too much friction. It’s too hard 
to relax with this person. It’s just not worth my time. ( technician , dealership) 

Patience is another behavioral characteristic that is necessary to win the 
approval of employers and peers. In the occupation of auto repair technician, 
patience was denoted by quiet diligence and emotional restraint. Virtually all 
practitioners were periodically confounded by impasses in their work. These 
could be an elusive electrical fault that defied repeated attempts at identification, 
a stripped head bolt lodged in the bowels of an engine, or a motor mount so 
corroded that no amount of torque or solvent could break it free. Occasionally 
technicians were held responsible for errors that occurred through no fault of 
their own. For example, several informants recalled instances of completing a 
laborious and difficult rebuild only to find that an equipment supplier or parts- 
room attendant had given them the wrong components at the outset. All infor- 
mants reported feelings of frustration and outright anger when confronted by 
such mishaps. 

Many technicians were tempted to give vent to their frustrations in these 
situations, and a few actually did — reports of shouting, swearing, spitting, kick- 
ing vehicles, throwing tools, and generally indulging in fits of temper were not 
uncommon. Although peers could empathize with the offending party, such 
behavior was never condoned. Employers considered it grounds for immediate 
dismissal, and peers shunned colleagues given to emotional outbursts. It was 
particularly risky for neophytes to behave in this manner, for their lack of expe- 
rience could more easily give rise to problems and frustration and because they 
were watched more closely and indulged less than experienced employees. Far 
better was an approach that demonstrated patience: 

The fact is, sometimes you’ve gotta do things over. It may be an awful job, it 
may not be your fault, and you may have just finished swearing to yourself that 
you’d never do that job again. But you know what? You gotta do it. So don’t 
bitch about it, don’t have a fit. Don’t throw your tools or kick the car. Count to 
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10 and just do it. . . The other guys will respect you for it. ( technician , indepen- 
dent shop) 

Communication 

Communication with laypeople, and clients in particular, is unlike communi- 
cation with fellow technicians, other employees, and managers. In general, ex- 
changes with organizational outsiders were considerably more circumspect un- 
less the technician had a special relationship with the speaker. Tones were 
moderate; speech was clear and noticeably “clean” — free from profanity or any 
remarks that might give offense. Employers and technicians spoke approvingly 
of those who demonstrated “respect” for clients by listening carefully, being 
courteous, and attending to their concerns in a sincere and responsive manner. 
Moreover, interactions with clients were not occasions for erudition. Discourse 
had to be sufficiently specific and technical to explain the problem or repair and 
give the impression that the speaker was competent, but not so obscure that 
clients, who generally possessed little knowledge of automotive technology and 
repair, became befuddled. 

A puzzled or nervous client is a liability in automotive repair. To success- 
fully engage in problem diagnosis and repair, workers must question motorists 
about their vehicle’s symptomatic behavior and history in a manner like that of a 
physician with a patient. The speed and accuracy of diagnosis often hinged on a 
few scraps of information gleaned from a client’s description of the problem. But 
confused, intimidated clients were less able or, in some cases, less willing to 
supply needed information. Informants confided that many customers were hesi- 
tant to reveal how little knowledge they actually possessed about automotive 
technology and, consequently, refused to say much of anything (see Nelsen, 
1995). Thus, to guard against puzzling clients, technicians had to rid their speech 
of most technical jargon and, perhaps more importantly, rid themselves of the 
assumption that laypeople would probably understand what they were talking 
about. Effective communication called for the use of simple descriptions, fre- 
quent repetition, clarifying questions, and elucidating metaphors — communica- 
tion techniques that are unnecessary with peers. 

In contrast, communication with community members (including some shop 
owners and managers) was far more technical and direct. Peers, managers, and 
such visitors as equipment suppliers shared membership in a speech community. 
Thus, technicians could reasonably assume that they understood technical prin- 
ciples and terminology as well as cultural norms condoning the use of joking, 
shouting, whistling, and profanity within the bounds of the community. The 
need to monitor one’s speech and check behavior was reduced considerably. 
However, technicians could not assume that peers and employers would under- 
stand their actions and methods, particularly when doing something that seemed 
odd, unusual, or potentially unsafe. This is of particular concern to neophytes, 
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who are subject to extreme scrutiny during the first months on the job. New hires 
could do much to avoid attributions of incompetence by communicating their 
intent before proceeding: 

You can’t assume that other people understand why I’m doing something or 
what I m doing. This is especially true if I know that I’m going to be doing 
something that’s really obvious but strange looking. Sometimes I’ll prepare 
people for what I’m about to do. I’ll say, “This is what I’m going to do, and this 
is why I’m going to do it. I know it’s going to look strange.” And if it’s 
something I’m not real sure about. I’ll ask for a second opinion. . . . “Do you 
have a suggestion on a way that I can do this better?” Now, if new guys would 
learn to do that before they look foolish or before they get in trouble, it’d be 
much better. ( technician , repair franchise) 



Manipulation of Symbols 

An important part of projecting a desirable occupational image is under- 
standing how to identify and manipulate those ideas and objects that symbolize 
competence, professionalism, and membership in the community of practice. 
Various objects can symbolize competence but perhaps none more so than the 
automotive technicians’ tools. In the field of auto repair, technicians are ex- 
pected to supply their own hand and power tools and handheld computerized 
diagnostic devices. Employers provide only larger diagnostic devices such as 
oscilloscopes, permanent fixtures like hydraulic lifts, and special tools needed to 
repair a specific make of car. So critical are tools to a technician’s livelihood that 
it was widely held that one could accurately judge a practitioner’s technical skills 
and attitude from the condition of these objects. Tools in poor condition indi- 
cated a lack of ability and caring, whereas well-maintained tools suggested prow- 
ess and professionalism. Entry-level technicians were not expected to possess 
the vast collection of tools common among experienced workers nor to feature 
expensive brands of equipment in their kits. But they were expected to own the 
tools needed to perform basic repairs and to have tools that were of reasonable 
quality, neatly organized, and well maintained. 

In fact, service managers and shop owners took the condition of a prospec- 
tive employee’s tools as an indicator of the candidate’s promise — a box neatly 
stocked with well-tended tools was guaranteed to impress while tools in disarray 
or disrepair met with disapproval. Service managers and shop owners regularly 
asked to inspect applicants’ tools during interviews. As one explained, “If the 
box looks like garbage, I figure the guy does garbage work. And I don’t want him 
here.” Clients also appeared to be impressed with tools, for technicians claimed 
that employers would strategically assign work bays most visible to the public to 
technicians who had neat, impressive collections. Upon a neophyte’s arrival at a 
shop, the newcomer’s tools once again became an object of attention. By casu- 
ally borrowing an item from the newcomer’s kit, experienced workers could 
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appraise the selection and condition of the items within and form an immediate 
impression of their owner. Judgments were based even on the nature and condi- 
tion of the case in which tools were kept. Metal boxes and rollaway chests that 
were clean and dent-free were admired; plastic boxes covered with grime and 
decals were disparaged. One technician recalled the negative impression he had 
unwittingly created by toting an unimpressive tool box: 

I walked into my first job carrying my tools in an old fishing tackle box. ... I 
saw the older mechanics eyeing me, but nobody said anything until I was get- 
ting ready to leave a couple years later. One of the old-timers said, “Jim, when 
we saw you walk in with that tackle box, we bet amongst ourselves that you 
wouldn’t last the month. We thought you must be stupid if you carried that 
thing around. But you surprised us!”. . . There’s a good lesson in that. ( techni- 
cian , dealership) 

Accessing, Disseminating, and Evaluating Informal Knowledge 

An entry-level automotive technicians’ informal education can be speeded 
up with the help of a thorough understanding of the cultural rules for accessing, 
disseminating, and evaluating informal knowledge. One type of understanding 
involves knowing where to seek information. Quite simply, not all peers are 
equally knowledgeable. Informal knowledge is distributed in the community of 
practice along two dimensions. First, it is distributed among members by tenure. 
Those who have the longest tenure at the firm or in the business will have the 
richest stores of firm-specific and industry-specific knowledge, respectively. In- 
formal knowledge is also distributed throughout the community by technical 
specialty. Individuals working as transmission repairers are the logical source of 
information on shifting patterns; drivability technicians, on cold-start problems; 
brake installers, on rotor tolerances; and so on. 

When a piece of information is needed, neophytes need to sift through 
the collective competencies of community members and identify the most 
appropriate source for knowledge. This is necessary not only to obtain the 
most accurate and reliable information but also to avoid appearing naive or 
uninformed by asking improper questions. For example, asking a lube tech- 
nician whose experience is limited to changing oil and greasing fittings 
about a complex drivability problem would be viewed as absurd. However, 
if a neophyte discovers that, say, a transmission technician harbors an inter- 
est in drivability problems but seldom has an opportunity to display his 
knowledge, that person could become a valuable and enthusiastic informant. 
Individuals who have recently returned from training or who participate in 
continuing education courses are also good sources of information because 
they may be eager to demonstrate what they have learned. One technician 
took advantage of this opportunity by serving as an informal “study partner” 
for a peer who was studying for the Automotive Service Excellence (ASE) 
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certification examinations . 4 Although not preparing for the tests himself, 
the neophyte quizzed his partner using practice booklets and manuals during 
breaks. This tactic proved doubly useful— the drills exposed the neophyte to 
a valuable source of formal knowledge and drew him closer to an indebted, 
more experienced peer. Discussions of the practice questions also provided 
the neophyte with opportunities for eliciting informal knowledge drawn from 
his peer’s work experience. 

Once knowledgeable individuals are identified, neophytes are wise to culti- 
vate relationships with them. Although newcomers should attempt to win accep- 
tance among all community members, it is advantageous to secure the goodwill 
of those noted to be especially helpful or expert. This can be done simply by 
subtly acknowledging their expert status in the community of practice. Practitio- 
ners identified as being unusually skillful are usually treated differently than their 
less gifted compatriots. This may be reflected in forms of address. For instance, 
in one shop the resident drivetrain expert was introduced in the following man- 
ner. This is Tony. He s our transmission god.” Another expert was referred to 
as “a walking encyclopedia” of automotive knowledge. Although seemingly 
humorous, these words were spoken with sincerity and reverence. Respect was 
also manifest in interactions — when experts spoke, others paused to listen, and 
the experts’ opinions were not challenged casually. Technicians also noted that a 
potentially helpful informant may not be a peer. By lending an ear to a frustrated 
shop foreman, neophytes could quickly become a valued confidant: 

If the boss keeps ignoring what the foreman’s saying, and the foreman knows 
he’s right, he’s done the job over and over again, but the boss is thinking 
bottom line or thinking about sales or something else— the foreman will unload 
to somebody. And if it’s that new hire, that’s good— it builds a bond. I’ve seen 
that work out quite well. The boss never listens to the guy who’s managing the 
shop. . . . Play into it. Work with the guy who’s supervising you directly. And 
as a result, your life gets easier. ( technician , dealership) 

Relationships with knowledgeable peers are likely to be short lived unless 
neophytes understand and obey the rules of disseminating informal information. 
These concern how one should exchange information: rules of listening, taking 
turns, and not saying more than you know. Given their inexperience and provi- 
sional status, neophytes were expected to listen attentively and not interrupt 
excessively or speak out of turn when conversing with more senior workers. 
Joking and a bit of good-natured bragging were acceptable, even encouraged, but 
delivering advice that one was unqualified to give was frowned upon. Rules of 
information exchange also governed when one should seek information. Neo- 



4 “ASE” refers to the National Institute for Automotive Service Excellence, a national nonprofit 
organization that tests and certifies the competency of automotive technicians. To become certified, 
technicians must pass written exams designed to test their technical knowledge. 
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phytes were expected to refrain from making inquiries when the informant was 
rushed or engrossed in a complex problem, if possible, or to ask only short 
straightforward questions during such times. Break times and lulls in the work- 
day provided better windows for seeking detailed answers to complex questions, 
and the answers received during these times would usually be far more descrip- 
tive and extensive. 

A final type of understanding concerns the ability to evaluate information. 
The validity and accuracy of information obtained from both formal and informal 
sources could prove unreliable with surprising frequency. Thus, accepting any 
information at face value was to court disaster. Neophytes must therefore retain 
a healthy but quiet sense of skepticism and develop the ability to carefully weigh 
information gathered. If an answer or passage recorded in a manual didn’t seem 
right, technicians were expected to follow their hunch to determine if the suspect 
data were indeed faulty. As one technician noted, this process required both 
resourcefulness and determination: 

There’s no one source of information that’s going to be 100 percent correct. 
[Entry-level technicians] have to develop the ability to draw from different 
resources. I do it myself. I’ll go ask somebody, and if I don’t get a complete 
answer, or I’m not happy with the answer, or I don’t understand it, I’ll ask 
someone else or go to the book [manual]. And maybe 1 won’t like what I see in 
the book either, so ... I might go to a CD-ROM compilation. Or 1 might just 
need to see a good picture. ... If the illustrations aren’t in the book, maybe I 
can go find a similar-model vehicle and pop the hood [to] take a look at that 
one. That might mean a trip down to the dealer if it’s not a late model. Or 
maybe a call to the dealer. These are all techniques I’ve had to use. ( techni- 
cian , independent shop) 

Technicians related numerous tales in which they saved their reputation for safety, 
technical skill, and good sense by evaluating a passage of text or a piece of advice 
that struck them as odd before acting on it. However, they also warned that 
neophytes’ investigations should be conducted in a discreet, low-key manner to 
avoid giving the appearance of second-guessing more experienced colleagues. 
As one explained, “This is one time when it’s important to be quiet and go about 
your business.” 



Knowledge of Rules Governing Exchange of Assistance 

Virtually all entry-level technicians require considerable help. This can 
consist of simple gestures, such as showing the newcomer where supplies and 
equipment are located, to elaborate favors, such as offering detailed demonstra- 
tions of repair procedures. Experienced peers are fully aware of the newcomers’ 
need and are generally willing to assist. However, exchanges of assistance are 
governed by cultural rules. Newcomers must observe these rules to avoid wear- 
ing thin their peers’ good will. 
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For example, requests for assistance should be distributed throughout the 
shop to avoid overtaxing anyone in particular. When assistance is rendered, 
recipients should be attentive and make an effort to learn from the experience. It 
is not expected that a neophyte will retain complex information after a single 
hearing or viewing. But it is assumed that after two or three exposures the 
information will become embedded in memory. Technicians complained that 
nothing was so annoying or ill tolerated than “a new guy who asks the same damn 
question over and over.” In fact, such behavior was interpreted as a sign of 
general incompetence or an uncaring attitude. 

It is important for recipients to show gratitude when assistance is rendered 
and to adhere to the norms of reciprocity that govern such exchanges. These 
norms specify an even exchange of assistance or other favors. Of course, the 
entry-level technicians’ inexperience places them in a relatively poor position to 
reciprocate with exchanges of technical assistance, so they must discover other 
ways to make up their social deficit if they are to continue receiving aid. Entry- 
level technicians devised ingenious ways of settling their debt with peers. For 
example, one made a habit of passing a plate of home-baked cookies among peers 
several times a week. A second voluntarily swept clean the work areas of expe- 
rienced technicians at the end of each day. A third reported treating his co- 
workers to an occasional fast-food lunch. And one technician fulfilled his social 
obligations by occasionally purchasing new tools for helpful colleagues: 

It s a good idea to buy your way in,” like I did. If you borrow their tools, you 
might want to buy them a tool. Like, hand them a flashlight and say, “Here— I 
noticed your flashlight is busted, so I bought you a new one. Thanks very much 
for letting me borrow your tools and thanks for all your advice.” Let ’em know 
that their help pays dividends, {technician, independent shop) 

Of course, one must take care when fashioning such strategies; overt sweeping 
expressions of gratitude may be viewed as manipulative attempts to curry favor 
while perfunctory gestures could seem insulting. Although the actual methods 
used varied, acceptable means of repaying a social debt were always subtle, 
modest, and, perhaps most importantly, sincere. 

Knowledge of Ideal and Practical Demands 

In many cases there are “official” and “unofficial” ways of accomplishing 
tasks. The former are the methods decreed optimal by authoritative sources: 
manufacturers, suppliers, employers. Official procedures are featured in stan- 
dard operating procedures, technical service bulletins, manuals, and other textual 
sources. Unofficial methods are the procedures that technicians themselves fash- 
ion through experience, experimentation, and judicious application of informal 
knowledge. These are embedded in heuristics, shortcuts, and makeshift mea- 
sures. For instance, technicians routinely employ shortcuts by substituting proce- 
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dures of their own design for those in manuals, and they omit steps specified in a 
diagnostic or repair procedure deemed unnecessary for achieving desired results. 
Although unofficial methods can be more efficient or effective than official meth- 
ods, they may not carry authoritative approval. Therefore, becoming a competent 
practitioner implies learning not only the methods themselves but also which 
method is deemed appropriate for a given situation. 

Myriad factors guide the selection and application of repair methodologies. 
For example, workers must be sensitive to employer preferences — some employ- 
ers frown on informal methods while others encourage their use. In some cases, 
managers made their desires explicit: 

When I first started, 1 was fresh outta [community college] and thought 1 knew 
my stuff. But when I was doing my first brake job, I went to the boss and said, 
“Where’s the seal driver?” The boss said, “The what?” “You know, the seal 
driver ... to drive these wheel seals in.” He goes, “Son, come over here.” He 
got a 2 x 4 and a hammer and says, “Watch this.” And he showed me how most 
mechanics put it in without the special tool. 1 felt like a fool! fve always 
remembered this, and that’s why I try to tell young guys there’s a by-the-book 
way and there’s the way they do it in real shops. Know the difference. ( techni- 
cian , independent shop ) 

If managerial preferences were less obvious, neophytes could pick up shop 
norms by watching peers to see what fellow workers did and when they did it. A 
well-placed question to peers could also secure the needed information. In fact, 
experienced technicians considered such questions to be indicative of “shop 
savvy” — an understanding of and appreciation for the way work is really done in 
shops to save money, effort, and time. Demonstrating this knowledge helped 
neophytes shed the image of “being green” — naive and inexperienced — and 
speeded their acceptance into the community of practice. In contrast, consis- 
tently choosing and applying methods that technicians considered inappropri- 
ate — even if these are formal methods deemed optimal by manufacturers and 
employers — put neophytes at risk of being viewed as less than promising. 

This did not mean that neophytes could apply informal methods freely, how- 
ever, for cultural rules specify who can use informal methods as well as when. 
Experienced technicians agreed that neophytes should refrain from taking short- 
cuts unless they had accumulated enough knowledge and experience to make 
informed detours. Similarly, neophytes were expected to avoid attempts at ex- 
perimentation and innovation in work practices until they had mastered formal 
procedures and demonstrated their competence on repeated occasions. 

THE FINISHING SCHOOL— AN OLD IDEA REVISITED 

To date, discussions of workplace readiness and the perceived shortfall of 
skills among high school graduates have revolved around a delimited range of 
knowledge and skills. Most prevalent are complaints about the lack of basic 
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literacy and numeracy, followed by reports of a widespread lack of technical 
skills— knowledge of technology (computers in particular), critical thinking skills, 
and the like. However, the foregoing discussion suggests that social capital also 
is an indispensable part of the workers’ portfolio of skills and knowledge. These 
skills help entry-level automotive technicians communicate effectively, adapt 
their behavior to meet the practical and social exigencies of the workplace, and 
simultaneously avoid attributions of incompetence that impede employability 
and build relationships that facilitate learning and teamwork. Given the impor- 
tance of such knowledge, it may be advantageous to provide structured opportu- 
nities for acquiring social capital in vocational schools. But what must be done to 
provide such opportunities? 

Once again, the example of the finishing school is instructive. Recall that 
these schools were effective vehicles for imparting social capital because they 
circumvented three curricular and pedagogical shortfalls that often plague mod- 
em schools. First, the schools provided ample opportunities for students to 
experience social dynamics characteristic of adult roles in realistic settings. Sec- 
ond, these experiences were supplemented with formal instruction in social skills 
and knowledge and structured opportunities for practice. Finally, the social 
capital imparted in finishing schools was entirely consistent with that required in 
real-world settings. To effectively inculcate the social skills and knowledge 
required by today’s practitioners, vocational schools must also skirt these short- 
comings. This implies that schools must do the following; provide opportunities 
to experience social dynamics in realistic work settings, supplement experiential 
learning with formal instruction and structured opportunities for practice, and 
achieve congruence between social capital valued in schools and in the 
workplace. 



Provide Opportunities to Experience Social 
Dynamics in Realistic Work Settings 

To become socially adept, students must experience firsthand the social 
dynamics of the workplace. Many vocational schools do a fair job of replicating 
the physical environment found in work settings: classrooms may look like shop 
floors, laboratories, and examination rooms; tools and instruments plied in real 
work settings are used; and students engage in the sort of tasks they will soon 
perform. But these settings are typically devoid of the kind of people the entry- 
level technician can expect to encounter on the job. Clients, managers, suppliers, 
and experienced practitioners are conspicuously absent. As a result, teachers are 
the only resource for building social capital available to most students. If instruc- 
tors have some practical experience in the field, they can be a valuable source of 
information. However, in some school settings, students will interact with a 
single vocational instructor throughout their training or have few chances to 
mingle with others. Consequently, students may be exposed to the experiences 
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and social knowledge of only a single former practitioner. It is unlikely that any 
teacher’s experiences encompass the full range of social capital a student could 
possibly be called on to exhibit. 

Replicating the social dynamics of the workplace in school therefore re- 
quires creating opportunities for sustained social interaction with people com- 
monly found in the workplace. One means of accomplishing this goal is through 
increased use of internships, externships, apprenticeships, and other collaborative 
learning efforts between schools and employers in local labor markets. In addi- 
tion, schools could seek ways to introduce social actors into the classroom. En- 
couraging a group of local employers to release a practitioner from his or her 
duties for a few hours every week would be a start. These advisers could circu- 
late during practice activities, offering guidance, commentary on students’ be- 
havior, and, perhaps most importantly, an example of how full-fledged members 
of the occupational community of practice should behave. Managers and em- 
ployers could also make regular appearances in the classroom, not to lecture but 
to interact informally with groups of students as they work. Retired practitioners 
also represent a valuable source of social guidance, and such individuals may 
readily volunteer a few hours each week in the classroom. 

Supplement Experiential Learning with Formal Instruction 
and Structured Opportunities for Practice 

Internships and other occasions for sampling social dynamics provide excel- 
lent opportunities for practicing social skills in actual work settings. However, 
internships alone can prove inadequate for the same reason that medical residen- 
cies and craft apprenticeships often fall short of the mark — namely, few deliber- 
ate attempts are made to inculcate this knowledge during the training experience. 
Hence, students with natural talents in this area may excel and receive more or 
better opportunities for learning while their less fortunate peers struggle for rec- 
ognition and acceptance. Vocational schools could do much to level the social 
playing field by adding formal instruction in occupationally specific social skills 
to academic curricula and by creating situations in which students could practice. 

In the case of automotive repair, such instruction could be slipped into exist- 
ing lesson plans with relative ease. For example, a discussion of the cultural 
significance of tools and tool maintenance could be added to demonstrations on 
safe and effective use of tools and implements in the shop. It is likely that, once 
appraised of the symbolic importance of tool care, students may see the chores of 
tool maintenance and shop cleanup in a somewhat different light. Lectures on the 
rudiments of asking questions, seeking assistance, projecting a professional im- 
age, and repaying social debts could also be featured. Students could be graded 
on their social proficiency as well as classroom performance to instill a respect 
for these skills. 

Similarly, a short module could be added in which students have the oppor- 
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tunity to practice interaction and diagnostic questioning with volunteers recruited 
to play the role of customers in repair shops. After a few brief demonstrations by 
the instructor, students would take a turn at interacting with the “customer,” who 
could challenge students by behaving in a nervous, puzzled, officious, or obnox- 
ious manner. These sessions would be observed by students, teachers, and, 
ideally, practitioners and employers, who would critique each student’s perfor- 
mance and offer alternative approaches. Students could also engage in role play 
to practice social skills in problem solving and conflict resolution. These lessons 
would logically precede internships or other forays into actual work settings. 

Achieve Congruence Between the Social Capital Valued in Schools 
and the Workplace 

Formal instruction, practice sessions, and other well-intentioned efforts to 
impart social capital in schools will be pointless if the social skills these impart 
are not those needed in the workplace. Care must be taken to ensure that accul- 
turation in the classroom is congruent with that of the occupation for which 
students are preparing, for a basic lack of familiarity with the cultural rules and 
norms extant in the workplace can blunt pedagogical tools that are otherwise 
effective for imparting this knowledge. 

Evidence for this conclusion can be drawn from recent efforts to include 
social instruction in postsecondary vocational programs. In response to com- 
plaints from industry that technically skilled graduates frequently lack interper- 
sonal and written communication skills and an awareness of ethics and values, 
the American Association of Community and Junior Colleges has spearheaded 
efforts to include social instruction in vocational training (see Rzonca et al., 
1995:153-154). Under the association’s direction and with financial support 
from the National Endowment for the Humanities, a few pioneering community 
colleges have supplemented technical training with humanities courses. Al- 
though it is too soon to fully assess the courses’ impact, employers have already 
objected to their content and relevance (Collins, 1991). The problem appears to 
stem, at least in part, from a discrepancy between the social capital that academ- 
ics think employers want (and that academics are prepared to teach) and the 
social capital that new employees actually need. Humanities courses discuss 
generally useful ideas, attitudes, and behaviors but not the occupationally spe- 
cific skills and knowledge that students will be called on to exhibit upon entry 
into the workplace. 



SUMMARY 

My studies of the automotive repair field suggest that employers can unwit- 
tingly perpetuate such misunderstandings. During interviews, subjects were rou- 
tinely asked to comment on the skills and knowledge required of entry-level 
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automotive technicians. The comments of shop owners and service managers 
echoed themes surprisingly similar to those of employers in general — all were 
unanimous in the opinion that “values” and “having a good attitude” were abso- 
lutely critical for being hired and for continued success on the job. However, 
only upon closer questioning and sustained observation in the workplace did it 
become apparent that service managers were not referring simply to generally 
useful values, ethics, and behaviors but also to the ability to appreciate and 
observe occupational norms and cultural rules. This experience suggests that it is 
important not to accept such terms at face value and to be clear when stating 
employment needs. To develop effective vehicles for social training and accul- 
turation in the classroom, educators must acquire a detailed understanding of the 
social capital needed by entry-level workers. This requires detailed cultural 
studies of occupations and work practice produced with input from employers, 
managers, and, perhaps most importantly, practitioners themselves. 
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Manufacturing the New Worker: 
Literate Activities and Working Identities in 
a High-Performance Versus a Traditionally 
Organized Workplace 



Glynda Hull 



INTRODUCTION: THE SKILLS DEBATE 
ON THE FACTORY FLOOR 

While reports in the 1980s (e.g., National Commission on Excellence in 
Education, 1983) called attention to the ways in which schoolchildren were per- 
forming poorly at reading, writing, and math, worry has focused more recently on 
adults already in the work force or young people about to enter it. This time, the 
perceived deficits in workers’ “basic” and “higher-order” skills have been linked 
to lowered productivity in the workplace and a lack of competitiveness in the 
international market (U.S. Department of Education and U.S. Department of 
Labor, 1988; Carnevale et al., 1988; Lund and McGuire, 1990; for critical re- 
views see Hull, 1993; Gee et ah, 1996; Darrah, 1996)'. The claim is that in order 
to be competitive U.S. industries must adopt new technologies and new forms of 
work organization often labeled “high performance,” in contrast to more tradi- 
tional Taylorist models (Commission on the Skills of the American Workforce, 
1990; Secretary’s Commission on Achieving Necessary Skills (SCANS), 1992; 
Sarmiento and Kay, 1990; Appelbaum and Batt, 1993). The demand is that 
schools support these changes by teaching the knowledge and skills thought to be 
needed in restructured, technologically sophisticated workplaces (SCANS, 1992; 
see Marshall and Tucker, 1992). There is a developing consensus, then, that what 
is needed is a new kind of worker. 

Definitions of what constitutes high-performance workplaces vary, but these 
workplaces are usually assumed to require greater collaboration and communi- 
cation among workers, to provide increased opportunities for the exercise of 
different and more complex skills and literacies, and in general to give frontline 
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workers more responsibility. In addition, it is claimed that companies aiming to 
become high performance will need to make larger investments in training and 
offer higher salaries for the payoff of increased skills and productivity (see 
Commission on the Skills of the American Workforce, 1990; Carnevale et ah, 
1988; SCANS, 1992; Appelbaum and Batt, 1993; Brown et ah, 1993). In this 
atmosphere of change there is a tendency to speak about U.S. workers pejora- 
tively — to worry that our increasingly “nonmale, nonwhite, and nonyoung” 
(Ehrlich and Garland, 1988) work force is poorly trained and poorly skilled and 
therefore ill equipped to cope with new workplace demands (see also U.S. 
Department of Education and U.S. Department of Labor, 1988; Carnevale et al 
1988). 

Despite such claims about the skills, including the literacies, required in 
reorganized, technologically sophisticated workplaces, as well as about the 
skills that workers are assumed to lack, little is known about the actual de- 
mands of these workplaces or the kinds of training that new jobs might re- 
quire. (For a review of existing research, see Hull et ah, 1996; for recent 
examples of research on literacy, skills, and work, see Hull, 1997.) In fact, 
most of the complaints about worker “illiteracy” arise not from detailed obser- 
vations of work but from surveys and anecdotal reports that rely largely on the 
perspectives of managers (Baba, 1991; Darrah, 1996; Appelbaum and Batt, 
1993). It is not clear, then, just what literate capabilities are required in the 
new workplaces or even what literate capabilities workers possess or lack — 
although such information would seem to be crucial for reconceptualizing 
secondary and postsecondary schooling, vocational training, and workplace 
education efforts. 

This chapter is drawn from a larger research project designed to fill in some 
of these gaps. The aims of the project were several: to develop a methodology 
for investigating literate activities in workplace settings; to document the actual 
literate activities in a high-performance workplace versus a traditionally orga- 
nized one; to document the work activities associated with self-directed work 
teams and high-performance work; to make recommendations about literacy edu- 
cation and training for the present;and to find innovative ways to introduce edu- 
cators, researchers, and laypeople to the changing face of work. 

This chapter focuses on a subset of the larger project having to do with 
literate activities and working identities. Current public debates and concerns 
about skills and skill requirements are, I would argue, efforts to develop a na- 
tional consensus about new working identities — the ways of thinking, acting, 
talking, and valuing that are believed to be appropriate for the new worker. As 
we will see, a literate identity is an important aspect of a worker’s sense of 
himself or herself in a high-performance workplace. But, as we shall also see, it 
is perilously easy for companies to so structure and constrain work activities 
that— even at a high-performance plant— the identities that workers develop 
around literacy are conflictual and limiting. 
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BACKGROUND: THE VALLEY OF HEART’S DELIGHT 

The landscape is flat, hot, suburban, and bland — a seemingly endless juxta- 
position of shopping centers, parking lots, tract housing, freeways, and electron- 
ics firms. If you look to the east, the Diablo Mountain Range is always in view; 
to the west and out of sight are the southern reaches of the San Francisco Bay. 
Just 50 years ago this whole area was verdant with olive groves, vineyards, and 
orchards of apricots and walnuts. The quintessential land of milk and honey, it 
was dubbed by residents the Valley of Heart’s Delight. Today this 25-mile strip 
of the San Francisco peninsula is home to some 2,000 high-tech firms and some 
200,000 workers. It is Silicon Valley, and although one can find examples of 
industries other than electronics here, the area now belongs to the design, manu- 
facture, and assembly of computer boards, chips, and components. 

Silicon Valley is held up as a major economic success story in the United 
States and, as such, has gotten its fair share of attention from presidents, queens, 
and more ordinary visitors such as researchers. A recent example is Saxenian’s 
( 1 994) study of the unique local industrial environment that allowed young entre- 
preneurs to parlay their considerable technical know-how into multi-million- 
dollar empires. And there have been a host of popular accounts of individual 
visionaries, inventors, and their companies, such as Rose’s West of Eden (1989), 
a look at part of the history of Apple Computer. What is less common in the 
literature on the region are studies of frontline workers, the men and women who 
manufacture silicon chips and assemble circuit boards and do the actual work of 
production (for an exception to this tendency, see Hossfeld, 1988; see also Rawls 
and Bean, 1993, for a brief history). They constitute 80 percent of the Silicon 
Valley work force. Implicit here, of course, is the extreme segmentation of the 
valley’s work force into highly skilled technical and professional workers at the 
top, and the much more numerous production workers, often recent immigrants 
from Asia and Latin America who do not earn a lot more than the minimum wage 
and for whom opportunities to advance are few. Nonetheless, such workers are 
increasingly expected to cultivate new skills, acquire new knowledge, and par- 
ticipate in new work practices, such as self-directed work teams — in short, to 
develop new working identities. They are the focus of the current study. 

I examined one subset of the computer industry, circuit board assembly, an 
instance of contract manufacturing. We often hear that the most prevalent job in 
recent years is the temporary one, a trend that provides workers little job security 
and few benefits (such as health insurance) but that enables corporations to adjust 
their labor overhead to the ebb and flow of the market (for a critical look at this 
trend, see Parker, 1994). A parallel phenomenon to temporary hiring is contract 
manufacturing, also called “outsourcing,” and in fact, contract manufacturers 
depend heavily on temporary workers. Contract manufacturers perform services 
for other companies, often central services that were once performed by the 
companies themselves. For example, while big computer companies like Apple 
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and IBM used to assemble all their own circuit boards in house for their own 
products, it is now customary to farm out this aspect of their production. 

Being a contract manufacturer has particular implications for doing business 
and has ramifications as well for the skills its work force is called on to develop 
and use, especially literacy. A company chooses one contract manufacturer over 
another because of lower costs, higher quality, and productivity, so there is much 
ado in these companies about minimizing defects and speeding up production. 
Because technology changes so quickly these days, a contract manufacturer’s 
customers can be expected to be particularly demanding, calling for changes in 
circuit boards that are already in production and regularly returning old boards to 
be reworked and updated on short notice. Recordkeeping on such occasions is 
paramount: customers want to know what changes were made on which boards 
on what dates and by whom; paper trails are thick. Customers also want to be 
assured of a certain level of competence before they bring their business, and 
thus, circuit board assemblers, like a growing number of other U.S. and European 
firms, vie to be certified by international standards. These agencies enforce 
stringent procedures concerning documentation, so that factories are practically 
afloat in a sea of paper. It is customary for every single procedure that takes place 
within such a certified factory to be written down and documented, and workers’ 
activities and their work practices are expected to match the printed account and 
are regularly audited to ensure that they do so. 

My research team and I studied two Silicon Valley circuit board assembly 
factories, one a high-performance workplace and the other a traditionally orga- 
nized one . 1 The traditional factory we called EMCO, for electronics manufactur- 
ing company. The other we named Teamco, a pseudonym that highlights the 
company’s recent investment in self-directed work teams. What was remarkably 
fortunate about this choice of companies is that, aside from their policies and 
practices regarding work organization, EMCO and Teamco were very similar. In 
fact, I knew some frontline workers who were working simultaneously at both 
places, just on different shifts, though this was a violation of both factories’ 
policies. Other employees — line workers, engineers, managers — had previously 
switched from one company to the other, and employees continued to do so as the 
study progressed. EMCO and Teamco are both quite successful, posting profits 
in the billions. They are both international, having plants not only in the Silicon 
Valley but in various countries worldwide. Indeed, they are both large, employ- 
ing thousands of employees nationally and internationally. Their California fac- 
tories are both multicultural and multilingual, drawing on work forces composed 



] It is important to note that this dichotomy is in some ways a false one, for a company can at one 
and the same time embrace features of high-performance work organizations and traditionally orga- 
nized ones. To further complicate matters, companies sometimes “talk the talk” but do not “walk the 
walk.” That is, they claim to follow the high-performance model but in actuality rely on quite 
traditional practices. 
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mainly of recent immigrants. This striking similarity means that the study was 
not an apples-and-oranges comparison, the juxtaposition of two essentially dif- 
ferent work settings. Rather, the similarities made it possible to hone in with 
confidence on the differences in literacy requirements and practices that were 
associated with the factories’ different perspectives on work organization and the 
roles and identities of frontline employees. 

A NOTE ON METHODS 

Rather than relying on “grand tours” of the workplace, which can result in 
a limited and distorted view of workers’ and managers’ roles and activities 
(Darrah, 1990; Spradley and McCurdy, 1972), this project drew on ethno- 
graphic methods that allowed the investigation, in close detail, of the perspec- 
tives and understandings of the various stakeholders in the two workplaces. 
Fieldwork took place during a 3-year period, 1993 to 1995. Most data came 
from observations and interviews, the majority of which were audiotaped or 
videotaped. We also participated in the work of the factories on occasion, 
assembling the simpler products or helping out with literacy-related duties. 
One long afternoon, for example, I spent almost entirely on my knees along 
with the lead of one of the “hand-load” lines, meticulously combing the files 
of each set of manufacturing process instructions for each assembly in the 
plant. Our task was to determine the exact number of components that work- 
ers were expected to load for each assembly, figures that would then be plugged 
into a new formula for determining “standard times,” or how fast people needed 
to work. This task, like many other new responsibilities, grew from the 
company’s interest in making teams accountable for improving productivity. 
(For a detailed explanation of methods and the sociocultural approach that 
informed the research, see Hull et al., 1996.) 

Our public and official role in the factories was to be “researchers,” a group 
from a local university studying the literacy requirements of work. In some 
ways, however, our roles went beyond the usual notions of “participant observa- 
tion,” crisscrossing the boundaries traditionally set between researcher and re- 
searched. Members of the research team frequently provided personal assis- 
tance to individuals. Since many workers were recent immigrants whose English 
was shaky, we offered ourselves, and were regularly relied on, as language 
intermediaries. Once a worker who moonlighted in a Chinese restaurant brought 
in a menu so that we could record the English pronunciation of “pot stickers” 
and “vegetable fried rice.” I intervened on many occasions for a young supervi- 
sor, an ethnic Chinese who grew up in Vietnam but had developed an American 
penchant for credit cards and mail-order houses. Her query of “what is sweep- 
stake?” began a months-long saga of negotiations with a disreputable mail-order 
house to return $899 worth of pens. We read and commented on essays from 
night school, interpreted traffic tickets and insurance policies, ventured opinions 
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regarding medical options, and exchanged business cards with anxious parents 
happy to know a professor from the university where their sons and daughters 
were enrolled or had aspirations of attending. 

Our roles as language and cultural brokers helped people to trust us, 
people from whom we were separated by vast cultural and social gulfs. We 
became their friends as they became our informants, and these relationships 
helped us immeasurably as we attempted to understand work activities and 
social positions on the shop floor. In the same way, then, that a factory can be 
understood as the product of multiple influences — its industry, its local his- 
tory, the current economic climate, the vision of its managers — so can the 
attitudes, abilities, and actions of workers be usefully interpreted in light of 
their work and educational backgrounds, their individual styles and creativities, 
their cultures and genders. 

Fieldwork at EMCO (approximately 100 visits from May 1993 through Sep- 
tember 1994) resulted in over 200 hours of audiotape of interviews and work- 
related activities in all departments; 6 hours of videotape of training, manufactur- 
ing, and a team meeting; a database of all employees’ education and work 
experience; and a wide-ranging collection of documents — process instructions, 
engineering changes, assembly drawings, performance reviews and disciplinary 
notices, quality alerts and requests for corrective action, supervisors’ passdowns, 
workers’ notes and drawings, meeting agendas, interoffice memos, and much 
more. 

Fieldwork at Teamco (approximately 200 visits from September 1994 
through November 1995) yielded more than 300 hours of audiotape of work in all 
departments and of training, interviews, and a variety of meetings (including 
those of self-directed work teams and related committees) and approximately 100 
hours of videotape of self-directed work-team training, meetings, and related 
committees and of self-directed work-team competitions and presentations to 
management. Also, as in our fieldwork at EMCO, we collected a wide range of 
documents, from the training curriculum, from team meetings, and from the 
factory floor — including process instructions, time standards, workers’ notes and 
drawings, quality and productivity data, meeting minutes and agendas, and man- 
agement assessments of team goals. 

From these abundant data, I have selected two stories to tell, two narra- 
tives that demonstrate in dramatic form the literate activities that were avail- 
able to, expected of, or withheld from frontline workers at EMCO and Teamco. 

I present these narratives in some detail, introducing the workers who figure 
prominently in them, providing excerpts from their conversations, and de- 
scribing and summarizing their work or training activities. After these narra- 
tives I will turn to a more formal analysis of the literacy practices that were a 
part of the work of circuit board assembly, as well as the practices that distin- 
guished work at the traditionally organized factory from work at the high- 
performance plant. 
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A SNAPSHOT FROM THE FLOOR 

It is important, if we are to understand how literacy does and does not 
function on the shop floors of EMCO and Teamco, to know something about the 
work of circuit board assembly, for this work structures the reading and writing 
that gets done in these factories and gives literacy its purpose. Before turning to 
case studies from each of the factories, I offer a glimpse, a broad sweep, of the 
work that people do on such a manufacturing floor. We will catch this glimpse by 
following a “bare board 11 and a kit of components (integrated circuits, diodes, 
resistors, capacitors, brackets, nuts and screws, and so on) across the manufactur- 
ing floor on their way to becoming completed printed circuit boards. This is a 
generic, description, one that generally fits the circuit board assembly process at 
both EMCO and Teamco. 

Work begins in the storage and shipping department, where bulk compo- 
nents arrive and a “kitting 11 crew consults various documents — manufacturing 
schedules, manufacturing process instructions, bills of materials, approved ven- 
dor lists — to determine how many of which components are to be placed on 
which boards. The crew then makes up kits of those components, kits that will be 
picked up as needed by materials handlers from the various departments. Out on 
the floor the bare boards begin in an area referred to as “pick and place 11 or as 
“surface-mount technology 11 (SMT), which consists of lines of robots. A worker 
programs the machines to either spread solder paste or squirt daubs of epoxy on 
the board and then place the right components in the right spots. The boards, with 
components in place, continue along an automated line through an “oven 11 or 
reflow machine, which heats up and solidifies the solder. Although it is possible 
for a single person to load the machine, monitor the process, and catch the boards 
at the end of the line, it is more common for two people to share these responsi- 
bilities, with the person who catches the boards acting as an inspector to see that 
all parts were placed on the board properly. Roving inspectors also conduct spot- 
checks here and throughout the plant. 

A worker (a “materials handler 11 on some shifts, a pick-and-place “lead 11 on 
others) places the boards on trays or in sectioned bins called “totes , 11 sets the trays 
or totes on carts, and wheels the carts to a washing machine. (At EMCO, a 
movement log is filled out in triplicate and filed to document this and all transfers 
of materials in the plant; at Teamco a one-page “traveler 11 is filled out to accom- 
pany the cart, but the boards are also scanned at certain points to track them along 
the manufacturing process.) Another crew of one or two runs the boards through 
the wash, puts them back into bins, then puts them on carts, and wheels them to 
either “auto-insertion 11 or “stuffing 11 (also known as “hand-load 11 ). Though board 
designs rely increasingly on SMT, all boards still contain at least some “pin- 
through-hole 11 components, components that have small wire “legs 11 or “leads 11 
that stick through small holes in the board and are wave soldered or hand soldered 
on the back side of the board. Some of these through-hole components are placed 
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by machine in the auto-insertion area after going to SMT, others by hand in the 
stuffing (hand-load) and mechanical assembly areas. Stuffing is a line of perhaps 
a half dozen workers who hand place more components on the board, compo- 
nents that because of their size, shape, or other characteristics, could not be 
placed during the earlier stages of the process. The components added in auto- 
insertion, hand-load, or mechanical assembly require soldering and so are moved, 
according to the customer’s specifications, either to the wave-solder area or to the 
area known variously as “second ops” (second operations) or “touch-up.” Staffed 
by one to three operators, the wave-solder machine makes it possible to solder the 
leads of through-hole components en masse — an important time saver when a 
single connector might have a hundred leads or when a board might have a few 
hundred small through-hole components, each component with at least two leads. 

Second ops is the most labor-intensive part of the plant. It is here that 
workers (usually women) perform the hand soldering known as touch-up (adding 
final components) and rework (removing and/or replacing components). Second 
ops also includes some hardware assembly, where workers screw brackets to 
boards, add bar code labels, and snap in components that do not require soldering 
or that cannot be subjected to the wave-solder process. The assembled boards are 
then “shipped” to another department for in-circuit and functional testing and 
quality inspection. Depending on the results, the boards are next either sent back 
for rework or packed and shipped out. 

Surrounding and interacting with the manufacturing process described here 
is the work of designers, engineers, and managers of various kinds — the people 
who prepare for and oversee the manufacturing process and who interact with 
customers, vendors, and employees at other plants owned by the corporation. 

“OPERATOR BRAIN DEAD”: A READING PROBLEM AT TEAMCO 

The first narrative that I will tell to demonstrate the literacy activities and 
literate identities of workers in circuit board assembly has to do with a literacy 
problem, a documented instance of EMCO workers who apparently failed to read 
or follow instructions and thereby almost made a production mistake that would 
have had serious repercussions for an important customer. This story began one 
evening during EMCO’s second shift while I was “shadowing” a process engi- 
neer, Wade. (See Figure 5-1 for the chronology of this event.) This engineer, 
who usually worked during the day, was on special assignment to the second shift 
that evening. I followed Wade about as he made his rounds in the plant, stopping 
to check with the leads in each department to see if all was well, and I sat with 
him as he completed his main project for the shift, the construction and assign- 
ment of a rework task. 

The rest of this paper contains a number of transcriptions of conversation. I 
use the following transcription conventions: 




107 



GLYNDA HULL 



97 



[ ] 

( ) 

(XX) 



caps 



[ 2 ] 



researcher’s explanation 
researcher’s best guess 
unintelligible word or phrase 
overlap (simultaneous speech) 

latching (one speaker following immediately after another) 

cutting off word or phrase 

stress 

fluctuating intonation 
pauses of less than 0.5 seconds 
pauses timed precisely (2 seconds) 
omitted talk 



One of EMCO’s major customers had returned a batch of boards that EMCO 
had already assembled; the boards were to be upgraded and altered according to 
the customer’s current specifications, and the relevant paperwork was to be up- 
dated, approved, and appropriately distributed and filed. This kind of rework task 
is common in circuit board assembly, for computer companies are continually 




PfoCe'ss ’ie^fine^r, Box full of 35 or so printed circuit 

boards that have been returned from a customer for modifications or 
“rework” to bring them- up to current specifications. 




Rework begins; line workers solder, etc., create new labels, affix 
labels, and eventually send the completed boards to testing. 




Engineer Wade discovers the boards have been labeled improperly: 
investigates, talking to the supervisor, the line workers, his boss, 
other managers; issues a “Corrective Action Report” or “CAR to 
the appropriate supervisor; puts other boards on hold. 



9/29 The SOLUTION 






Supervisor meets with workers who did the rework to “retrain them, 
Wade releases the remaining. boards to the floor; new labels are 
made and Wade himself puts them on the boards; boards are 
released to the testing department. 

FIGURE 5- 1 Chronology of the “label problem ” 
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improving the design of boards that are already being produced. The challenge 
for a contract manufacturer like EMCO, then, is to simultaneously maintain 
production and to update the old boards that have already been assembled— and 
to do so quickly and accurately. 

The boards the engineer showed me that evening, which arrived in a batch of 
35 in one big box, each board worth about $600, were not all alike; that is, they 
represented five or six different versions of the same board, each version manu- 
factured at a different point in the design process. Wade therefore had to examine 
every board singly and sort each into appropriate categories. He made handwrit- 
ten notes to himself, listing individual boards by their serial numbers, notes he 
would later convert into instructions for the workers. As he explained, “The 
operators [employees who would perform the rework on the boards] will not have 
to look at it [each board] and try to decide what, which board. Just look at the 
number and know what (it takes. Checklist.” Having completed his sorting and 
note taking, he remarked that the rework would probably be done by a couple of 
operators and stretched out over several shifts. He said he would check the first 
few boards for “workmanship” but would leave the main inspection for the test 
and quality departments. 

During the next week members of the research team observed the rework 
that was done on a subset of the 35 boards, three especially complex “mother 
boards” that were designated “hot” or high priority; the oldest in the batch, these 
were the boards the customer wanted returned pronto. We observed the addition 
of a green wire, as directed in the instructions, by one worker, and another worker 
explained what she had done on the board, characterizing the rework as “straight- 
forward.” (For the specific rework directions, see Figure 5-2.) This employee 
added that all that remained, before the boards were sent to the test department, 
was the addition of a datecode label (also as mentioned in the directions), and 
another worker set off to make the new labels. 

We saw nothing that struck us as unusual during this process, but when 
Wade, the engineer, checked on the progress of the boards a few days later as he 
had said he would, the fur flew. “See the little jumper wires I referred to on the 
instructions,” he started to say approvingly as he showed me one of the com- 
pleted boards. Then he paused and noted quietly, “We got a problem here 
though. The instruction says to make a datecode label of A-3337. . . . Need to 
reject these.” 

Jamal, the lead in the test area, perhaps taken aback by Wade’s consterna- 
tion, pointed to the rework instructions and said to Wade, “I think this is your 
instructions.” “I know,” Wade replied, “and they didn’t follow them.” 

It was not that the workers had done the actual repair of the boards incor- 
rectly. In fact, as Wade would later point out, their handwork was so superb that 
the three boards were virtually identical, just as they should be. Rather, the 
problem was with the datecode label, a tiny identification affixed to every printed 
circuit board. (See Figure 5-3 for a replica of the actual label and Figure 5-4 for 
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2ND OPERATION 

For serial number 032 only, remove diode at location Z3. 

FOR ALL ASSEMBLIES, PERFORM THE FOLLOWING REWORK 

Remove 1C at location U16 (74BCT2440). 

Hand solder part number 1820-6307 (74HCT244) at location U16. 
Lift pin 19 of U17. 

Lift pin 11 of U34. 

Connect the following pins using #30 AWG green jumper wire. 
Insulate lifted pins with sleeving. 

U24 pin 1 to U34 pin 11 
U34 pin 10 to U17 pin 19 
Tack PAC wires every 1/2 inch. 

HAND CLEAN REWORKED AREA 



Remove M8 revision of the BIOS 1C at location U22. 

Install M9 revision of the BIOS 1C at location U22. 

Make new datecode label (A-3337). 

Apply new datecode label over old datecode on serial number label. 
Do not cover old serial number or assembly number of the label. 

Send assemblies to test. 

TEST 

Perform ICT if possible and functional. Record debug time spent and 
any rework performed on data sheets. 



.FIGURE 5-2 Excerpt from instructions for board rework and datecode label replacement. 

an enlargement and explanation.) The parts of the label include the datecode 
(which indicates the version of the board — in this case “B” — and the week and 
year it was manufactured — in this case the 37th week of year 33, meaning 1993) 
and the serial number, the unique identification number for that particular board. 
Wade’s instructions had directed the workers first to “make new datecode label 
(A-3337)” and then to “apply new datecode label over old datecode on serial 
number label.” He further directed, “Do not cover old serial number or assembly 
number of the label” (see Figure 5-2). The workers’ mistake was threefold: they 
had removed and discarded the original label; they had generated a whole new 
datecode label with a new serial number; and they had changed the version 
number on the new label from A to B. 



o 




110 



100 



MANUFACTURING THE NEW WORKER 




FIGURE 5-3 Datecode label: actual size. 



printed. Oir^it^^^ni'bly ^ h -s' 

■ V Humb£rn&6m 



Datecode 

B=revision 

33=1993 

37=week 




Serial Number: 000720 



FIGURE 5-4 Datecode label: explanation of parts. 



Upon discovering the mistake, the engineer hurried down to the shop floor to 
Find out what had happened. He called to the lead in the second-operations area: 



Wade: 


Marisa! (pause) RSD madre? 2 


Marisa: 


Yes. 


Wade: 


RMAs? [rework instructions] 


Marisa: 


Right. 


Wade: 


Did you make the stickers? 


Marisa: 


The sti-, yes. 


Wade: 


Day shift? Porque no A? How come there’s no (xx) serial 
number? (What did you do with the old) serial number? (Did 
you just) put new serial number for everything? Why did you= 


Marisa: 


=1 do not touch those. Who was the person? 



At this point, visibly alarmed, Marisa went to consult the operators who worked 
on the three boards, and they spoke together in Spanish for a moment, but nothing 
seemed to be resolved. Wade then instructed Marisa: “You’re getting 30 more 



2 Wade is monolingual, but he prided himself on learning and using a few words from each of the 
several languages spoken in the factory. 
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RMA boards out here. We have to know what serial number it is. . . . Looks like 
somebody took the old serial numbers off them. Now we can’t tell what serial 
numbers they are. Now we got problems. They’re gonna be on hold until I have 
time to check l em out. Make sure this doesn’t happen on the rest of them, okay? 

I need to go talk to Celia [Marisa’s supervisor]. . . . Gracias.” With this, Wade 
strode off to break the bad news elsewhere. 

At this point I was still somewhat mystified by the degree of consternation 
that accompanied the label problem, for surely, I thought, the labels could simply 
be reproduced and the error corrected. But this was not the case. As Wade 
explained several times over the course of the next half hour: [To^he researcher] 
“Now we’ve lost traceability on these boards. . . . Basically I do not know how I 
can identify them now. . . . This is kind of serious because it’s an irretrievable 

thing that you can’t really fix ” [to the quality engineer] “This is, this is kind 

of serious because the traceability is important and now we’ve lost it.” 

The concept of “traceability” is central to EMCO’s successful dealings with 
its customers. As a contract manufacturer, the company must keep exact records 
on all of its products, including recurring updates and modifications, and the 
recordkeeping applies to individual boards as well as to types of products.. In this 
case the three mother boards had been taken out of particular systems, and the 
customer expected to replace each board accordingly. (The program administra- 
tor in charge of this particular customer toyed only fleetingly with the idea of a 
cover-up: “So now what do we do? We could fake it . . . but that would come back 
to haunt us.”) It is significant that “traceability” is inexorably linked to literacy. 
And it is important to note as well that some employees at EMCO understand and 
participate in this practice and that others don’t, despite the fact that it has impli- 
cations for the work of almost all. 

By the end of the day Wade had written a “corrective action report” to 
Marisa’s supervisor; that is, he had put the problem in writing and the offend- 
ers on notice. He had also spoken to the supervisor, who promised to take the 
issue up with her shift at their meeting in the morning. He had stopped 
production on the remaining batch of 30 or so boards, for fear the same mis- 
take would be repeated. And he had carried out his own detective work, 
managing to figure out which board was which among the three in question. 
The next day he supervised the creation of new datecode labels, checked them, 
and pasted them on the boards himself, and then he released the remaining 
boards to the floor. 

What interested me most about this small drama was how the mistake had 
occurred, especially since the error was apparently connected to workers’ failure 
to read, understand, or follow written instructions. When I asked Wade how he 
thought it had happened, the following conversation occurred: 

Wade: Probably related to another acronym we have here, “OBD.” 

Researcher: I hesitate to ask. 
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Wade: It stands for “operator brain dead.” 

Researcher: Uhh-oh. 

Wade. Occasionally we run into that, not too often. 

When he described the problem to Frank, a fellow engineer, Frank observed that 
the operators must not be reading the instructions. Wade replied: “Well, they 
may be reading them, but they’re definitely not following them.” Later in the 
conversation Wade complained: “We’ve got to make them [the workers] under- 
stand that maybe they should read these things and follow them. I don’t do them 
[write the instructions] just to justify my existence.” 

Apparently, Wade was not sure whether workers had failed to read the in- 
structions or had read them and failed to follow them; but it was six of one and 
half a dozen of another to him, and in any case an example of the malady he 
referred to several times as “OBD.” This view was, however, inconsistent with 
Wade’s overall characterization of the workers as competent, even too compe- 
tent: when trying to distinguish the three boards one from another, he noted that 
the rework was so finely done that he could not tell the boards apart through 
physical evidence. And at various times he offered other examples of the work- 
ers’ expertise. 

Another possible explanation, one that perhaps would occur most quickly to 
literacy specialists, is that the text that workers were expected to read was un- 
clear, ambiguous, or vague. In fact, the program administrator offered this expla- 
nation when he first heard about the label problem, albeit jokingly: 

Rod: So this must reflect on the instructions provided by the, uh, the 

engineer, I guess the cognizant engineer. 

Wade: I keep telling you I’m not cognizant, [more quickly] You’ve 

got the instruction that says in there— 

Rod: —Yeah, yeah, do not cover up the old number. So now what 

do we do? 

Since Wade was responsible for writing the rework instructions, Rod could not 
resist the chance to tease him about his prose. Surely, the instructions (see Figure 
5-2) could have been worded more clearly. It is also important to note that the 
frontline workers weren’t allowed to construct or alter manufacturing process 
instructions, these most important of factory documents, so they were continually 
at the mercy of Wade’s prose and that of other engineers. Incomplete, inaccurate, 
or obsolete instructions were something we heard many complaints about, al- 
though the workers grew accustomed to deciphering or to working around these 
on a daily basis. 

Another interpretation that relates to language has to do with the fact that this 
was a largely immigrant, in fact largely Korean, work force. The perception was 
that most of the Korean workers and many of the other immigrants could not 
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speak English, could not understand English, could not read and write English, 
and, furthermore, were not all that interested in learning how. “What could help 
us here,” said one manager, “is an intense ESL [English-as-a-second-language] 
program. The Koreans would resist that — my impression — none of ‘em ever said 
that. I just have this feeling they would not be receptive. The women were going 
to ESL class and for some reason they just discontinued that.” In fact, some of 
the Korean women were so interested in learning English that they were attend- 
ing a literacy program especially for Asian immigrant women after work in a 
different city some miles away. 

Here is what Sook Yoo, one of those women, had to say (through an inter- 
preter) about not speaking English well: “I think there is a reason why we do not 
speak English that well. When we started working at EMCO, our starting pay 
was so little. But since we did not speak much English, we just took the starting 
pay. We started working and stayed for a while, but since the pay was so little, 
there was no time for us to study, realistically, because the pay was so minimal. 

. . . And we were so busy trying to survive. Since we came up that way, even 
now, we do not have a lot of money, and we are leading a hard life.” 

Sook Yoo and the other women in the literacy class went on to explain that in 
their community people resist governmental assistance, proudly preferring to earn 
the little they get. This, plus the value placed on higher education for their children, 
often necessitates taking two jobs. The result is too little money, too little time to 
learn English. Not being able to speak English, they pointed out, means not being 
able to defend yourself in the workplace when you’re accused of a mistake, and, 
most importantly, it means a greatly reduced chance of promotion, even when you 
do your current job very well. There are no Korean supervisors, they observed, in 
this high-tech workplace where international certification standards require that 
manufacturing process instructions be written, read, and communicated in English. 
They wished that the company had continued to provide English classes on site, but 
the classes had suddenly been discontinued. Sook Yoo concluded: “So we lost the 
chance to learn English, and now we are too old.” 

The manager was right, then, that there certainly were some workers, mostly 
Korean, who did not speak much English, but he was way off base in assuming that 
they did not want to learn. I should also point out that it is not necessarily the case 
that workers who do not speak much English do not understand much. Over and 
over my research team found that workers in factories like EMCO understand 
much more than is apparent. As one employee put it, many workers “cannot speak 
nice but understand.” Further, in our fieldwork at EMCO and Teamco, we regu- 
larly observed workers translating for each other; indeed, leads for the various areas 
and lines at EMCO were chosen in part because they are bilingual and can serve as 
literacy and language brokers. At both factories immigrants with limited English 
skills appeared to meet their companies’ quality and productivity goals despite the 
fact that not all of them speak, read, or write English well. I am not arguing that 
things would not be easier overall if everyone in a plant spoke and was literate in 
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the same language; however, work does get done quite competently even when this 
is not the case. We should not, then, automatically assume that limited English was 
the reason the three boards were mislabeled. 

Let us turn now to explanations provided by employees who worked on the 
shop floor. The first shift’s supervisor, Celia, on whose watch the label problem 
occurred, believed her workers read the instructions too quickly to notice what 
was salient and that they did so because they were mistakenly in a rush to finish 
the boards so that they could be moved to another department: “They know that 
they have to read. Each RMA [rework instruction] is usually always different. In 
this case they read it but read it so fast that they did not comprehend everything 
that . . . needed to [be done], so they missed it. . . . They feel like it’s a shift type 
of thing. They need to produce enough assemblies. Whatever they touch and 
work on, they need to move it on to test. It’s a quota-type thing. It isn’t.” 

Thus, this supervisor attributed the label error to another error, the workers’ 
belief that if any boards were waiting for them on their shift, they should be 
moved on to the next step in the manufacturing process, to the next department, 
as quickly as possible. Although this supervisor made a point of insisting that 
quality was most important and that the workers were wrong in thinking there 
was some kind of quota they needed to reach on a given day, my research team 
observed plenty of instances in which workers felt pulled in two directions — high 
quality versus high productivity. “Push, push, push,” one worker said of another 
supervisor’s modus operandi. At Teamco the complaint was similar: How can I 
keep my quality high if I must work faster and faster? Thus, this tension is a fact 
of life that workers have to cope with, even when it remains unacknowledged, 
and, conceivably, it could have had something to do with the label problem. But 
let us ask the workers themselves. 

Marisa, the lead in the hardware department, was the person who made the 
incorrect labels and passed them to another worker, Tran, to be affixed to the 
boards. She first commented, “It’s too bad that you [the researcher] have to find 
out about these boards. We are not supposed to make mistakes like that.” She 
had several explanations for the problem, the first resembling the supervisor’s 
analysis in that it also focused on time — work that day had been hectic: “It was so 
busy that day . . . and besides they tell me, 'Oh, we have these three boards’ and 
they said ‘we need to ship these three boards.’ ” Clearly, Marisa thought the 
boards were “hot,” that they had to be shipped pronto, so she may have given the 
written instructions short shrift. She also pointed out that Tran, the worker who 
actually pasted the labels on the boards, was new and that she had not had time to 
train him sufficiently. Next time, she promised, she would have an experienced 
person work on the special boards. 

Marisa’s other explanation had to do with how work was organized on the 
floor, especially the literacy requirements of work. It seems that one worker in 
Marisa’s department, Mrs. Kim, always read the entire set of instructions for each 
board and let people know if anything special was required. On the day the three 
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mother boards were reworked, Mrs. Kim was absent, and the person who took 
over her job did not act as the literacy broker for the rest of the workers. “She just 
read her part,” Marisa complained. “Mrs. Kim always reads the whole thing and 
then she tells you.” Not alerted to the special directions, Marisa made new labels 
according to the customary process. 

Interestingly, if Marisa had read the instructions herself, she would certainly 
have known what to do in a procedural sense — leave the old datecode label on the 
board; prepare a new, smaller label with a new month and year; and paste it on top 
of the old one. Marisa would also have understood that the process was done this 
way because the customer wanted it done this way. However, as will be clear from 
the following transcript, she would not have understood the role and importance of 
such documentation in the all-important practice of maintaining traceability: 



Researcher: 

Marisa: 

Researcher: 

Marisa: 

Researcher: 

Marisa: 



Researcher: 

Marisa: 



Do you have to understand what the numbers [on the label] 
mean? 

Yes, this is the datecode. We’re supposed to leave old label. 
Customer wants to change new datecode. I make small label 
with datecode and cut it and put it on top of the other one. 
Why is that so important to the customer? 

We’re not supposed to remove the old label. That one, we’re 
supposed to leave it on there. 

Do you understand why they care that much about whether the 
old label’s there? 

Uhhhmm, not really, but we just have to follow what the cus- 
tomer wants if he, they, say “I want you guys to remove that 
label, we just want to leave it alone, just change datecode.” 

Do you understand why it’s such a big deal? 

I not really understand that. 



It is quite significant, I would argue, that workers like Marisa were expected to 
read and follow directions but not to understand their significance. This suggests 
another reason for the error, not having access to global knowledge about the 
manufacturing process that makes tasks understandable and meaningful. If 
Marisa had understood the relationship between labels and traceability, and if she 
had understood the role of traceability in contract manufacturing, she might have 
paid more attention to instructions to make particular datecode labels. 

The last worker interviewed about the board problem was Tran, the person 
who had pasted Marisa’s incorrect labels on the board. His explanation for his 
part in the mishap was simple — reading directions was not part of his job: 



Tran: Only the lead take care. 

Researcher: Only the lead takes care? 

Tran: When I’m not lead, I’m not looking. 
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Researcher: 

Tran: 

Researcher: 

Tran: 



Not looking at the MPI? [manufacturing process instructions] 
Yeah. Only the lead take care. 

Did anybody ever show you how to read the MPI? 

No, they did not show. 



Even as a new employee, Tran recognized what I had learned from the managers 
early on in the study: EMCO’s policy was that only workers designated as “leads” 
for each line or area are responsible for reading written instructions; they are then 
supposed to spread the word orally. As we saw with Marisa, sometimes employ- 
ees work out an informal system whereby someone besides the lead is the literacy 
broker. But the official policy — which originated in large part as an attempt to 
compensate for what were perceived to be English-as-a-second-language prob- 
lems, especially among the Korean workers “who weren’t keen on learning En- 
glish”— was that only the leads were required to read. Thus, Tran, did not feel 
compelled to read Wade’s rework instructions and could not be blamed for his 
choice, given EMCO’s policy on literacy responsibilities. 

The story of mistaken labels and my subsequent analysis of the possible 
reasons for the mistake suggest that it may indeed matter, and matter a great deal, 
that work is organized so that frontline workers are not supposed to read. It 
would seem that not only should frontline workers be expected to read, but they 
will also need to possess a greater knowledge of the plant’s operation and the 
industry’s practices if they are to accurately interpret what they will need to read. 
Thus, one could argue that being fully literate in such a manufacturing environ- 
ment goes beyond being able to decode instructions on how to apply a datecode 
label and includes as well global knowledge about the industry — such as under- 
standing the important concept of traceability. 

It is clear that frontline workers at EMCO do not ordinarily think of literate 
activities as central to their work or, to put it another way, they do not construct 
working identities — ways of thinking, acting, talking, and valuing— that have 
much to do with literacy and print. And it is clear that supervisors and engineers 
do not expect or encourage frontline employees to develop literate identities as 
workers. All this is quite an irony, given the trend toward excessive documenta- 
tion in such workplaces and the central role that such documentation appears to 
play in the manufacturing process. 



“YOU HAVE TO WRITE IT DOWN”: 

THE LITERATE PRACTICES OF TEAMS 3 

The narrative from EMCO suggests the importance of literacy in circuit 
board assembly, even at a factory deemed to be traditionally organized. Further- 
more, at EMCO work was actually arranged so as to require as few literate 
responsibilities as possible of the frontline workers. I have illustrated how such 

3 This section is based partly on Gee et al. (1996). 
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an arrangement can spell trouble. Let us now turn to a second company and a 
different story. At Teamco every frontline worker is required to be a member of 
a self-directed work team. Teamco represents, in fact, a dramatic turnaround 
from the first factory in terms of training policies, work organization, and the 
responsibilities and roles of frontline workers. One might say that Teamco has 
attempted to create a new work culture and, in so doing, has wanted to foster new 
working identities among its employees. In such an environment one would 
certainly expect the development of new and different literacy demands, new 
literate practices that keep pace with the development of new work practices. We 
will thus want to ask, as we proceed with this story, how the literacy and work 
practices at Teamco compare with those at EMCO. What sorts of forums or 
spaces are made available at Teamco for workers to take part in decision making 
and to display their newly developed or newly acknowledged literate and prob- 
lem-solving capabilities? 

Teams in this factory corresponded to work areas. That is, all the people who 
worked in shipping were on one team, all those in a hand-load line were on 
another, those in touch-up on another, and so on. Officially, each team was 
supposed to meet for a half hour each week, every week, although this varied 
greatly in practice. For instance, one team from the test department met unfail- 
ingly each Monday at 7:00 a.m. for an hour. I was aware, however, of other 
teams that met sporadically or only for the benefit of my research team and others 
that had yet to meet during our stay at the factory. Some supervisors or coaches, 
I soon learned, were less than enthusiastic about the team concept, and “hot jobs” 
or a heavy production schedule were apt to take precedence over team meetings. 
When team meetings did happen, they were held in a variety of places, partly 
dependent on the size of the team. Large teams of 20 people or so commandeered 
the training room, while smaller ones crowded into a cubicled conference room 
that abutted the factory floor or held their meeting at a table in the noisy cafeteria 
adjacent to the cubicles but off the factory floor. 

Officially, team meetings were supposed to be conducted according to 
certain criteria. There was supposed to be a team leader and a minutes taker, 
and there always were in the meetings that my research team and I observed. 
These jobs were to rotate among members, which sometimes happened and 
sometimes did not. The team leader was not supposed to be the same person 
as the lead worker on the line or in an area, although this was sometimes the 
case, as we will see below. (Ironically, there were not supposed to be lead 
workers at all; these positions had been abolished with the advent of teams, 
when authority and responsibility on the floor were to be shared among all 
workers. However, in practice, leads were still leads and were recognized as 
such.) Each team had a binder in which minutes were recorded on printed 
forms. There was supposed to be an agenda for each meeting, and there were 
recommended forms of participation, such as brainstorming and saying “pass” 
if you had nothing to report. 
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Perhaps most importantly, team members were expected to engage in a 
seven-step problem-solving process, which had been covered in the self-directed 
work team curriculum. By means of this process, workers were supposed to 
analyze the causes of problems in their areas (through the use of fishbone dia- 
grams, Pareto charts and such), implement and evaluate a solution, and measure 
the results — activities that certainly required considerable expertise with literacy, 
mathematics, and language, not to mention knowledge of manufacturing. Later, 
during building-wide and plant-wide competitions, selected individual teams were 
expected to present the results of their problem-solving activities to management; 
they were judged then on their presentation style as well their results. 

One other team activity is worth previewing before we eavesdrop on an 
actual team meeting. Shortly after I began my observations of teams, manage- 
ment announced plans to link self-directed work teams directly to productivity 
and quality results, and these results to compensation. This was done by requir- 
ing all teams to set specific quality and productivity goals for each fiscal quar- 
ter — that is, all teams completed a form containing graphs of their previous 
quality and productivity percentages and a rationale for their future goals — and 
by rewarding those who met their goals with a bonus. Team leaders were ex- 
pected to compute quality and productivity on a daily basis, to record these scores 
daily in a computer program with a security system (to prevent cheating), and to 
report back to the team, so that problems affecting the teams’ scores might be 
solved. Then, at the end of the quarter, the money available for bonuses would be 
divided equally among teams who had met their goals; those who had not met 
their goals would receive nothing. 

There was naturally some interest and worry on the part of workers about 
this new system. In the past, bonuses of varying amounts had simply appeared in 
the pay envelope of some individuals. Under the old system the rationale for 
determining bonuses was never made explicit, though everyone had a theory — 
it’s how much overtime you’re willing to put in or it’s how well you get along 
with your supervisor. With the advent of teams, individual performance would 
cease to be rewarded in favor of the team unit; no matter how hard an individual 
might work, his or her fortunes would rise or fall with those of the team. It 
follows, then, that one important potential activity for team meetings would be 
setting goals and monitoring weekly performance on quality and productivity, 
with an eye toward determining whether or not team performance was likely to 
result in a team bonus. 

The story I tell here is the gist of a half-hour meeting of the “Aeon” team. 
This team was from the hand-load area, an area of the plant that does not require 
much training, although all employees in this area must take basic electronics at 
Teamco Tech once they become permanent hires. Workers in this area place 
components on boards by hand. This work begins when a line is assigned a batch 
of boards from a customer (such as Intel, Hewlett-Packard, or Apple). The lead 
decides how to apportion the work among the six people in her line — that is, how 
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many and what kind of components the first person in the line will load, and so 
forth. The boards are pushed from one end of the line to the other, with each 
worker incrementally adding a different set of components. In front of each 
worker is a color-coded diagram, indicating schematically which parts should go 
where. 

The last person on the line is the “QC ” or quality control; she inspects the 
work done by the others and, when necessary, refers to a set of manufacturing 
process instructions, the major document on the floor, as does the lead. Written 
by engineers, these instructions describe what workers are supposed to do in each 
factory department or area in order to assemble a given circuit board. After 
inspection the QC loads the boards onto a cart, and they are wheeled off to the 
next department. While the others are assembling and inspecting the parts, the 
lead worker continues to organize the work, troubleshoot, or help out on the line. 
The pace is intense; there are time standards for each board and contradictory 
pressures on the workers, given team goals, both to work faster and to work 
cleaner, increasing productivity and decreasing defects. 

This hand-load team called itself “Aeon” after a major customer. It con- 
sisted of seven women, all of them immigrants. Two of the women, Xuan and 
Eva, play a big role in the team meeting that I will soon discuss. Xuan is of 
Chinese heritage. She grew up in Vietnam and speaks Vietnamese as well as 
Cantonese fluently but lacks confidence in English, which she began to acquire 
when she arrived in the United States 4 years ago. Young, in her 20s, is small and 
soft spoken, and although she is the lead of her hand-load line and in charge of 
her team’s meetings as well, she often has trouble influencing the workers to 
participate in team activities. The supervisor of the hand-load lines reports that 
Xuan has no desire to promote, but I noticed that Xuan routinely and ungrudgingly 
took on more and more responsibilities regarding teams and their reporting re- 
quirements and that she became quite adept at the growing paperwork surround- 
ing goal setting. She also used every opportunity to learn English, although 
shyly. Her team had the best quality and productivity scores of the hand-load 
area, with almost perfect quality scores, or zero defects, and productivity that 
sometimes exceeded 100 percent. Xuan was engaged to be married; she and her 
fiancd were planning a traditional Chinese wedding celebration at a local restau- 
rant in the coming year. 

Eva, the most recent hire in Xuan’s hand-load line, is originally from the 
Philippines. Her English is very good, and because of this she was the informal 
spokesperson for the team, despite the fact that Xuan was its leader and Eva, the 
most recent hire. Eva was also responsible on most occasions for taking minutes 
during the meetings. Married with two children, she often commented that she 
has two jobs, one at Teamco and one when she went home to be a wife and 
mother. Eva was hired initially as a temporary, as are all workers at Teamco, and 
during the time that I knew her, she was very proactive in attempting to be made 
permanent. When all the other members of her line refused to take on the tedious, 
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eye-straining job of quality inspector, she eventually volunteered for it, for the 
supervisor had hinted broadly that it would help her chances of becoming a 
permanent hire. Although she claimed to be afraid to talk to the supervisor and 
often asked me to intervene on her behalf, Eva was quite outspoken at team 
meetings and on the line, so much so, in fact, that she regularly offended some of 
her co-workers. Eva was made permanent about 5 months after she was first 
hired, earlier than is the norm. 

The meeting we will examine here took place after the Aeon team had been 
meeting regularly for 4 months. Most, but not all, of the team members had 
completed training on how to participate in self-directed work teams; one notable 
exception was Eva, who as a recent hire was still classified as a temporary 
employee and was ineligible for the training. The meeting was held in the 
cafeteria at 2:00 p.m., 1 hour before the day shift ended, while workers from 
various departments were milling about the room. I had attended almost every 
meeting of the Aeon team thus far, had gotten to know everyone, and was viewed 
by most as a friendly resource, someone who could give advice about literacy- 
related team activities and someone to whom it was safe to complain. 

This meeting of the Aeon team began, as they all did, with our exodus from the 
shop floor to the cafeteria. Team leader Xuan went around from station to station, 
quietly but insistently announcing in a high-pitched voice, “Team meeting, team 
meeting! I walked with Eva, as was our custom, for she enjoyed providing quick 
summaries of what had been happening the previous week. Eva confided that she 
had given Lan, her supervisor, an “ultimatum” about being made permanent. When 
I asked what she had told her exactly, Eva confessed that she had written her a note, 
being afraid to speak to her face to face, and that she had explained she would have 
to leave Teamco were she not made permanent soon. The group gathered around a 
cafeteria table in the usual manner, with Xuan and Eva at one end next to me, the 
others grouped near us, and Mrs. Chen, the pariah of the group, some distance 
away. The first part of the meeting was a recital of the week’s problems, common 
fare for any hand-load line. There was the big board that required each person on 
the line to load 59 components apiece, and the additional problem of having had 20 
of these boards returned to the line because certain parts had been reversed. There 
was the problem on another board of “mixed parts,” the mistaken use of one part 
that is the same size and color as another but that has a different value, and a 
problem with 4 oent legs,” the disturbance of the tiny wires protruding from compo- 
nents that fit down into the board. Here is an excerpt: 

Eva: [to researcher] Oh, we’re having a hard time doing the Lexicon, 

the big board. The one Lan told you had more than 300 compo- 
nents. 

Xuan: 375. 

Eva: One person [has] to load 59 components at every station. 

Researcher: One person? 



o 

EKIC 



121 



GLYNDA HULL 



111 



Eva: We spent 2 hours finding our own location. 

[Much laughter] 

Xuan: Yeah ( ) the location, 1 minute, the other side [miming with her 

hands finding the locations on the board] 

Eva: We did about 20 boards from 8 to 3, and then the next, the 

following day, they returned to us, reverse [meaning the line had 
made a mistake, putting the parts on in the wrong direction]. 
[Laughter] 

All this talk proceeded casually, with much laughter and joking and with no 
one taking control of the meeting or enforcing an order of business, though Eva 
with her good English and strong personality tended to dominate. Interspersed 
among the discussions of typical hand-load problems were other topics of inter- 
est — a startled realization that someone had forgotten to bring the book for taking 
minutes, a critical observation about the short dress of a cleaning person who 
walked past the table, a report of a rumor that more production lines were soon to 
be added, a complaint about a noxious smell in the wave area. 

After Eva mentioned John, a Filipino worker who said he did not want to 
work in the wave area because of the smell, there was a pause of several seconds 
until Xuan brought up the issue of productivity. One day the previous week, it 
seems, their line had had a productivity score of only 55 percent, which was 
below their stated goal for the quarter. Xuan explained that “the lady,” by whom 
she meant the female engineer, thought the calculation might be wrong, that it 
should be higher, and Eva urged Xuan to make the correction. However, Xuan 
stated that it was too late, implying that once recorded, the score could not be 
changed. Here is their exchange (which includes overlapping and interrupted 
conversational turns): 



Eva: 

Researcher: 

Eva: 

Mai: 

Eva: 

Xuan: 

Eva: 

Xuan: 

Eva: 

Xuan: 

Eva: 



Did you check the lady about the 55 percent = 

= Mhm =. 

=of what we did ah just any - 
Just any -? 

And he told you to check it to the lady. So did you check it? 
Yeah, I check already. 

What did she said? 

She said it might wrong you know because hand-load they 
write in the mechanical ( ) that’s why= 

=Thaf s what, so how many percent now? 

(50) percent, [slight pause] You cannot change it. 

Aaaaaahhh. 



After this exchange Xuan continued to focus the group’s attention on poor 
productivity, pointing out that one day this current week the line’s score was only 
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57 percent. Eva s agitated question of “why, why, why?” brought a quick and 
spirited explanation constructed jointly— in fact, almost simultaneously— by sev- 
eral people on the team. (See the complete transcript of this discussion in Appen- 
dix 5-A.) It seems that the Aeon line had been asked to load components on a 
new board, the Acuson, during a period of enforced idleness. (A machine was 
down, making their customary boards unavailable.) The Acuson was a board 
ordinarily loaded by another line, and the Aeon team was not familiar with it. 
The board was especially complex, requiring 21 tiny transistors and much tedious 
masking. There were only five people on the Aeon line to do this work, whereas 
the line that usually loads this board has seven workers. Nonetheless, the Aeon 
line managed to complete 120 Acuson boards, working 2 hours of overtime. Yet 
their productivity was below their goal. This conversation indicates how savvy 
these workers were as a group, even those like Mai, whose spoken English was 
quite limited and who did not ordinarily participate much in meetings: they knew 
precisely why their productivity was low for that day and could marshal all sorts 
of details and evidence in support of their explanation, albeit in what might be 
viewed as a random and rowdy manner. 

The next topic at the meeting was how to document this problem. Eva stated 
loudly to Xuan, “You have to put a note on the paper. . . . You have to give them 
a reason, ’ meaning that Xuan should take care to write down on their score sheet 
an explanation for the low productivity score for that particular day. Xuan 
defended herself, saying she usually writes these things down but on that day she 
simply forgot. Eva retorted with spirit that Xuan may have forgotten to write, but 
she will remember the bonus — and maybe the team won’t get one: 

Then you have to make a note at the back and tell tell them the 
reason why is our productivity is so low that day. So they will 
give us credit for that= 

==I know, yeah, this time I forgot. 

Ay-yai-yai! Oh:: 

[much laughter all around] 

Did you see every time, did you see every time we have a 
meeting or something else I put a note on my paper? 

Yeah== 

==Yeah, you have to do that all the time. 

(17 related turns omitted) 

I write a note already. 

Good. 

But that Acuson I forget [laugh]. 

[laugh] You forgot the Acuson. 

[Much laughter] 

Okay. 

You’ll remember the bonus ( ). 



Eva: 



Xuan: 

Eva: 

Eva: 

Xuan: 

Eva: 

Xuan: 

Researcher: 

Xuan: 

Researcher: 

Researcher: 

Eva: 
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[Much laughter] 

Eva: [teasingly] Maybe we do not receive any. 

[Much laughter] 

The meeting began to wind down. Eva asked jokingly whether anyone had 
been fighting — “everybody fighting?” — a reference to the rather steady history 
of conflicts between Mrs. Chen and the rest. Mrs. Chen responded that “every- 
body tired,” which prompted a whispered conversation about her rumored wealth 
and some raucous comments on what she could do about her high blood pressure. 
Eva then turned the conversation one last time back to their productivity for the 
week, asking Xuan, “How many percent we have this week?” Although she did 
not have the numbers at hand, Xuan, with help from the team, was able to 
reconstruct from memory their scores for the first 3 days of the week: 77 percent 
on Monday, the infamous 57 percent on Tuesday, and 75 percent on Wednesday. 
The data had not been analyzed for Thursday, but the group felt confident that 
their score was fine for that day. I averaged these data and reported that their 
score was 69 percent thus far for the week, well above their quarterly goal of 60 
percent. Xuan then consulted a little black notebook she always carried in her 
pocket and announced that for the entire quarter thus far their productivity aver- 
age was 82 percent but that their quality was poor and still a problem. No one 
commented. The half hour set aside for the meeting had passed, and the Aeon 
team wandered back to the floor, chatting in groups of two and three as they 
walked. 

This meeting of the Aeon team certainly does not fit the usual notions of a 
formal meeting, at least the notions of those accustomed to some variation on 
Robert’s Rules of Order. Nor does it abide by the guidelines set up by Teamco 
through its self-directed work team curriculum. There was no agenda; there was 
no apparent order of events. There was no problem-solving a la fishbone dia- 
grams and Pareto charts or any other reminder of the self-directed work team 
classes. There was really no one in charge. People wandered in and out of the 
conversation, paying attention to what interested them, ignoring the rest. Talk 
was simultaneous, overlapping, and latched, as one person repeated the words of 
the current speaker or finished someone else’s sentence or interrupted or talked 
on top of another. There was much laughter and joking. One member of my 
research team who had lived in Southeast Asia and speaks fluent Vietnamese told 
me that the meetings transported him to Vietnam, that the participants were very 
“close” to that culture, not yet being completely Americanized, and that they 
seemed to draw on common Vietnamese participant structures. It seemed to me, 
as well, that there was something reminiscent here of kitchen table conversations 
among women everywhere, something most of us have witnessed or experienced. 

Although the meeting may have appeared chaotic, it is important to note that 
some important work of the team was getting done. One can point, for example, 
to the litany of hand-load problems at the beginning of the meeting, dutifully 
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noted in the minutes— reversed parts on board number 158294, bent legs on 
number 4929194 a significant step in identifying and documenting the line’s 
quality problems. Then there was the jointly constructed explanation for their 
team s low productivity on one particular day — they were working on a complex 
board foreign to them, and their line was short the requisite workers. This 
explanation allowed them to account for a problem if not fix it. And then there 
was the team s discussion of how to document extenuating circumstances so as 
not to be penalized on their productivity record and ultimately their team-based 
bonus team-worthy activities all. The fact that so much work was accom- 
plished in this informal, folksy gathering, and that there was participation by 
workers who did not speak in other forums that I observed, makes one wary of 
preconceived notions of what counts as a good meeting. Indeed, I witnessed less 
lively, more dreary gatherings of other teams that did abide by the letter of the 
law for how to conduct a meeting but appeared to accomplish less. 

Another indication that the Aeon workers were acquiring the sensibilities to 
operate as a team is their attention to documentation. The enormous reporting 
apparatus associated with productivity and quality scores for teams — alluded to 
in the above transcript, especially in Eva’s comments — underlines the increasing 
role of literacy in this factory and the ways in which writing, reading, and compu- 
tation took their place in day-to-day work events. Every week, it seemed, engi- 
neers or supervisors would invent a new form or revise an old one, most of them 
designed to enforce careful recording and analysis of data collected on productiv- 
ity and quality rates. The data were then transferred to computer programs, 
which generated the myriad graphs and charts that lined the walls of the cubicles 
on the perimeter of the factory floor. 

For the most part, leads buckled down and mastered the massive new report- 
ing requirements, attending the meetings in which new forms and methods of 
calculation were introduced, computing their scores and filling out their forms 
each day after work, keeping a bottle of “Wite-Out” nearby, and acquiring the 
technological sophistication needed to wade through and modify vast computer- 
ized databases. They also groaned — “No, not another form! So much paper!” — 
and noted that the paperwork was an additional burden in an already burdened 
workday. Workers were quick to notice the ways they could turn paperwork to 
their advantage. Eva’s zeal to write down explanations for the team’s low pro- 
ductivity is a good example. Xuan’s little black book of important numbers and 
facts is another. And when faced with strict reporting requirements that rigidly 
divided the day and the work into unworkable segments, workers learned to 
fudge, altering what they reported so that it would fit the forms. 

One could say, then, that a part of the new working identities of people on the 
front lines at Teamco had much to do with literacy and numeracy. All of a 
sudden, not only were hand-loaders expected to be quick and accurate at their 
work, they were also, with the advent of teams and new systems of reporting and 
monitoring, supposed to conceptualize their work differently. They were now to 




GLYNDA HULL 



115 



include as part of it an understanding of goals, goal setting, calculations, and 
reports and all the literate acts these activities entail. Put another way, workers 
were asked to conceive of themselves not just as employees who performed the 
physical act of placing components on a board but also as thinkers, as people who 
monitored their own hand-loading rates, reflected on and analyzed their prob- 
lems, and reported on this through print and through presentations. 

However, there is more to the literacy practices and the working identities at 
Teamco, a darker side of the story. I have cited some instances of workers’ 
taking charge of literacy, so to speak, not only acquiring the various practices 
valued at the company but also turning writing to their own purposes creating a 
paper trail, documenting a reasonable explanation for their low productivity on a 
given day. I must point out, however, that for the most part the kind of literacy 
valued in the factory emphasized self-monitoring, not self-direction, and that 
workers had no choice but to abide by rigid documentary rules — recall Xuan 
being resigned to the fact that, once entered into the computer, her team’s produc- 
tivity score could not be changed even if it was wrong. Leads spent inordinate 
amounts of time counting, figuring, and tabulating, all in service of accountabil- 
ity. While self-directed work teams were supposed to be empowered to solve 
their own problems, managers and engineers appeared so compelled to measure 
and document quality and productivity, to find ways to quantify the teams work, 
to keep tabs and to keep track — all through literacy-related activities — that work- 
ers were left very little room to maneuver. 

One more literacy-related example will make this point. I have already 
mentioned that manufacturing process instructions were the central documents 
on the shop floor. These instructions were written by engineers, and there was a 
set of them for each individual circuit board. They outlined the manufacturing 
process from beginning to end, for each department or area, and listed the type, 
amount, and serial number of each component to be affixed to the board. These 
central documents were consulted when engineers determined standard times, or 
how long it should take to complete a given piece of work on a board. These 
standard times, of course, influenced productivity scores. It was well known on 
the factory floor that manufacturing process instructions were often wrong or 
outdated. Busy engineers did not always have the time to make corrections, or 
they overlooked tiny details that made the difference between a board that worked 
and one that failed or between achieving one’s productivity goal for the day and 
missing it. Despite the fact that the engineers knew about the problems with the 
manufacturing process instructions, workers were absolutely prohibited from 
changing them, from making an alteration even of the smallest kind. 

On one afternoon I was watching Xuan as she studied one manufacturing 
process instruction. She eventually found the problem she was looking for the 
author had mistakenly written a “1” where an “11” should be in the column 
listing the number of components. This simple mistake had major implications 
for Xuan’s line in terms of productivity calculations. It obviously takes 1 1 times 
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longer to load 1 1 components than it takes to load 1; the group’s “standard time,’’ 
or the amount of time allotted for assembling that board, was thus way off kilter, 
and so would be their productivity— if they went ahead and assembled the board 
as it should properly be done. I reached over with a pencil and attempted to write 
in the other numeral, whereupon the usually mannerly Xuan gave a startled shriek 
and ordered me away, explaining that we must not, and the workers must not, nor 
even could Lan the supervisor, modify a manufacturing process instruction. She 
and her group went ahead and did the boards correctly and suffered the conse- 
quences. But other workers took different approaches: A couple of test operators 
found one engineer especially difficult to work with whenever they approached 
him about errors or omissions in his test process instructions, so they quit telling 
him and instead took to troubleshooting the test process instructions themselves 
and working from the revisions they had penciled in in their own notebooks. In 
other cases, workers refused to make changes they knew were needed when the 
manufacturing process instruction was incorrect, even if the engineer gave verbal 
permission to do so. “Do not go by verbal, go by written,” Mr. Marco warned his 
group again and again, having been burned once too often. 

In some ways, I would argue, the literacy practices of the factory — who was 
enabled to read and write which documents for what purposes on which occa- 
sions— were a window on the work practices of the factory as a whole and the 
hierarchical structures that governed them. Despite the fact that Teamco required 
its work force to organize around teams, required those teams to meet, and 
required them to solve problems and to continually find ways to improve and 
document their quality and productivity — despite the fact that it claimed to want 
a thinking work force, a self-directed, and empowered one — I saw continual 
evidence that workers received a conflicting message, that they were in fact quite 
constrained in terms of the actions they could take, the decisions they could 
make, the influence they could have, and the literacies they could practice. While 
the working identities of people on the front lines of this factory increasingly 
included a sense of their work as “intellective” (Zuboff, 1988) and as connected 
to, directed by, and shaped in relation to written texts, their sense of themselves 
as workers continued to fit the old mold. They were employees very much in 
the grip of a hierarchy that insisted on self-monitoring but allowed very little 
self-direction. 



FORMAL ANALYSES OF LITERATE ACTIVITIES 

Thus far in this chapter I have offered narratives, tales of two factories, if you 
will. Through them I hoped to provide a detailed and nuanced sense of what 
work is like in circuit board assembly and the role of literacy in that work as well 
as a feel for who the workers are. So much talk about “skills” is done acon- 
textually these days, with scant reference to actual situations, particular work- 
places, and real people. This way of talking about skills has a tendency to 



O 

ERLC 



127 



GLYNDA HULL 



117 



misrepresent the nature of working knowledge and leave us with pat, inaccurate 
skill lists and related curricula. Thus, I hope that my narratives, which try to 
locate what people are required to know and do as workers within the social, 
cultural, and political worlds of the factory, will serve as a corrective to the 
tendency to always speak generically of skills. 

In the following section I try to go beyond the broad characterizations that 
are possible through narrative accounts and present an analysis of the literate 
requirements of work in finer detail. Because my research team relied exten- 
sively on audiotaping and videotaping its data collection, it was possible in most 
cases to transcribe quite precisely the talk that occurred in meetings, in training 
sessions, and on the shop floor. (See, for example, the transcript provided in 
Appendix 5-A.) These transcriptions, supplemented by field notes and docu- 
ments, were coded inductively according to the functions that reading and writing 
served. That is, my research team and I noted any use of or reference to reading 
or writing, and drawing on our knowledge of the situation, the participants, and 
the activity, we determined the function that use served in that particular instance. 
As we analyzed more and more transcripts, we added to and emended this emerg- 
ing taxonomy of literate functions. At the end of our analysis, we had identified 
approximately 80 functions that literacy served at EMCO and Teamco; these are 
listed in Appendix 5-B. 

Making sense of this analysis required one more step. Taking our list of 80- 
odd literate functions, and again working inductively, we grouped like categories 
together. For instance, the literate functions copying and labeling were put in the 
same list, and the functions creating hypothetical and problem solving were 
grouped together in a different one. When we were finished, we had created 
seven broad meta-categories of literate functions: performing basic literate func- 
tions; using literacy to explain; taking part in discourse around and about texts; 
participating in the flow of information; problem solving; exercising critical 
judgment; and using literacy to exercise, acknowledge, or resist authority. The 
meta-categories and their members appear in Appendix 5-C. 

Then it was a matter of returning to the analyses of work events on the shop 
floor, training classes, and team meetings and re-presenting these according to 
the meta-categories. The resulting worksheets allow one to see, almost at a 
glance, which participants in which situations used literacy in which ways and 
with what frequencies. 4 

Before going on to discuss what this kind of literacy analysis makes visible, 
I should provide some caveats on using the taxonomy. The meta-categories 
represent robust tendencies rather than hard and fast rules. That is, depending on 
the context, any literate function, although usually an example of one particular 



4 In addition to analyzing the functions that literacy served in team meetings, work events, and 
training sessions, my research team and I developed two additional coding schemes, one centering on 
team meeting activities and a second on classroom activities. 
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meta-category, might fit better into another. Thus, the meta-categories suggest 
primary allegiances, but less frequently any function can be used in a variety of 
ways. Further, almost any function might fit into the last meta-category — that is, 
using literacy to exercise, acknowledge, or resist authority — again depending on 
context. One warning, then, is that the meta-categories should not be used as just 
another set of skill lists but rather as a heuristic for analyzing and understanding 
literate activity. 

A second caution has to do with the ordering of the meta-categories into a 
continuum, beginning with performing basic literate functions and ending with 
using literacy to exercise, acknowledge, or resist authority. The performing basic 
literate functions meta-category includes uses of literacy such as copying, key- 
boarding , proofreading, and labeling. The final meta-category includes literate 
functions such as gaining consensus, gauging reactions, and requesting action. 
One of my greatest worries in offering the meta-categories in this particular order 
is that they will be read as representing a kind of developmental progression. 
That is, some educators, researchers, or laypeople might infer that first workers 
(or students) need to master the basic literate functions; then they progress to the 
second category of using literacy to explain; eventually they will be sophisticated 
enough to engage in those functions in the last meta-category, using literacy to 
exercise, acknowledge, or resist authority. Nothing could be further from what 
my research team and I found in our fieldwork or how I intend the taxonomies to 
be used. It is true that the meta-categories are ordered according to a progression, 
but this progression has to do with rights and opportunities for exercising literate 
abilities. 

As I will illustrate in the following section, we saw both workers and manag- 
ers engaging in literate activities from all seven meta-categories. However, the 
categories on the left-hand side of the chart — performing basic literate functions 
and using literacy to explain— are the categories most often associated with and 
available to frontline workers. The categories on the right-hand side of the 
chart exercising critical judgment and using literacy to exercise, acknowledge, 
or resist authority — are the categories most often associated with and available to 
those in positions of authority, such as supervisors, managers, and engineers. In 
other words, the meta-category chart and the continuum it represents lay bare 
how patterns of literacy use are linked to structures of authority. 



Literacy Finding 1: Much Ado About Literacy 

In recent years there has been much ado about increasing skill requirements 
in the workplace, literacy included and literacy in particular. I think that this 
assessment, at least in its broad outlines and general direction, is accurate. There 
can be no doubt about it — both EMCO and Teamco were awash with literacy. Or 
to mix metaphors, literacy provided the frame, the scaffolding, the superstructure 
within which work got done at these circuit board assembly plants. My evidence 
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for this claim is the 80-odd functions that we saw reading and writing serve on the 
factory floors, in meetings, and during training sessions. This number suggests 
something of the remarkable diversity of the literate activities in these work- 
places. But I can give a richer sense of this range by turning to a few examples 
that highlight some of the functions and also the seven meta-categories into 
which the functions are grouped. 

Let’s first review the Aeon meeting from Teamco. You may remember my 
characterizing the meeting as kitchen table talk among a group of women. Aeon 
team members showed little awareness of (or perhaps it was interest in) the 
expected conventions for running a meeting. But even at this quite informal 
gathering of workers from the lowest prestige and, some would say, lowest- 
skilled area of the plant, I identified some 44 instances of literacy representing 
functions from four of the seven meta-categories — performing basic literate func- 
tions; taking part in discourse around and about text; exercising critical judgment; 
and using literacy to exercise, acknowledge, or resist authority. The most fre- 
quently used category was taking part in discourse around and about text, as the 
lead, Xuan, and the unofficial team spokesperson, Eva, repeatedly referenced 
documents they had on hand or cited documents, such as quality reports, that 
played an important role in their work. Particularly noteworthy was their discus- 
sion of the necessity of documenting problems on the line so as to protect and 
defend their productivity scores. “You have to make a note at the back and tell, 
tell them the reason why . . . our productivity is so low that day,” Eva insisted to 
Xuan. “Did you see every time, did you see every time we have a meeting or 
something else I put a note on my paper?” she continued to scold. In their 
exchange Eva invokes a rule about recordkeeping and at the same time admon- 
ishes Xuan to do a better job of this literate responsibility. She also raises the 
specter of the team’s possible failure to meet productivity and quality goals and 
the related failure to get a bonus — all because the team leader had not made the 
required written accounting of the circumstances surrounding the team’s low 
scores. These are examples par excellence of a sophisticated understanding and 
use of literacy to exercise, acknowledge, or resist authority. 

At EMCO, as well, there were instances of literate activity from each of the 
major categories. In one such instance a lead worker, Eduardo, struggled to 
correct an obsolete document. In this work event I identified instances of each of 
the literacy meta-categories — from performing basic literate functions to using 
literacy to exercise, acknowledge, or resist authority. Especially notable were the 
high number of instances in the meta-category taking part in discourse around 
and about text and in exercising critical judgment. Many of the instances of the 
latter involve Maggie, the supervisor, and Eduardo interpreting the engineer’s 
documents, evaluating proposed solutions, and critiquing the engineer’s obsolete 
documents. In the following excerpt, Maggie and Eduardo had been working at 
the problem for some 200 lines of transcript. They have examined all the docu- 
mentation and have brainstormed a number of possible solutions. Here Maggie is 
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perusing the manufacturing process instructions, rereading parts aloud, while 
Eduardo is contextualizing the activity, providing background on the various 
shifts’ work on the board. Next they look at the assembly drawing again, critiqu- 
ing it and then referencing the manufacturing process instructions to discover the 
last time the documents were updated. 



Maggie: Uh huh. [reading from manufacturing process instructions] “In- 

stall Q 6, 7, 12, and 13 with mounting hardware after solder 
flow.” After solder flow . . . [.06] hmmm. “See detail A. Add 
CR 1 after solder flow.” 

Eduardo: I guess the last time we di- day shift did this one- 

Maggie: Oh, okay. 

Eduardo: Day shift did this one. 

Maggie: After solder flow. Mm hmm. 

Eduardo: They put on this one and then they just put the hardware on 

these two. See, but that’s the deficiency, they’ve been putting 
on the different part, and see this one, now no detail of this one 
should be cut in the middle; this one should be bent like this. 
That’s what I’m saying. “Just follow the drawing,” but this 
much different. 

Maggie: Yeah, the draw- the drawing is definitely wrong. And how old 

is this manufacturing process instructions? [Reading a date on 
the manufacturing process instructions] “4/26/94 update BOM 
[bills of materials].” This is 8/13 when they initially released 
this to manufacturing. 

Eduardo: The drawing says 1979. 

Maggie: [laughs] Bingo! See, this. . . . 



In summary, then, there was evidence at both EMCO and Teamco — at tradi- 
tionally organized and high-performance factories — to suggest that literate ac- 
tivities are woven throughout the work of today’s circuit board assembly. Now 
let us turn to the patterns of literacy use that distinguish one factory from the 
other. 



Literacy Finding 2: The High-Performance Hoopla 

The popular discourse on high-performance versus traditionally organized 
factories has generally assumed that high-performance work requires more and 
different skills. In terms of literacy and in broad strokes, I have found this to be 
the case. Despite the fact that we saw instances of literacy from all of the meta- 
categories at EMCO, the traditionally organized factory, there were striking dif- 
ferences as well. In essence, literacy use at EMCO among frontline workers was 
restricted according to position; leads got to exercise literate abilities to a certain 
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extent, but work was organized in such a way that the masses of frontline workers 
did not get to do so. Further, at EMCO literate functions on the right side of our 
continuum — using literacy to exercise, acknowledge, or resist authority; exercis- 
ing critical judgment; and solving problems — were much more likely to be per- 
formed by supervisors, managers, or people in traditional positions of authority. 
At Teamco, on the other hand, a wider range of workers were called on to 
exercise a wider range of literate abilities across the continuum. In particular, I 
saw more instances of frontline workers performing literate functions associated 
with the right side of the continuum, the power side. This occurred mainly 
through the opportunities and intellectual space provided in team meetings. 

To consider these points in more detail, let us return to the narrative about 
EMCO labels presented earlier. In this event were instances of each of the 
literacy meta-categories — from performing basic literate functions to using 
literacy to exercise, acknowledge, or resist authority. However, it is notewor- 
thy that the only person to participate in this broad range of literate activities 
was the engineer. Wade performed a variety of basic literate functions, such 
as recording , tallying , and matching. Readers will recall, for example, how he 
sorted the box of returned boards and wrote down identifying information 
about them. But Wade participated in many other literate activities, too — 
explaining the literate problem of labels to a variety of personnel, citing liter- 
ate rules about how to write corrective action reports, instructing workers and 
their supervisor about how to create correct labels, brainstorming to solve the 
problem of the mistaken labels, reprimanding workers in writing. Astonish- 
ingly, the only literate activities that one worker, the lead Marisa, participated 
in during the labels event were in performing basic literate functions — key- 
boarding and copying — and participating in the flow of information clarify- 
ing her role in the labeling process. 

There were occasions when workers at EMCO got to do more, especially 
certain leads (as we saw above with Eduardo), but in general literacy practices 
were quite restricted at this factory. In virtually all our analyses, line workers 
were absent across the categories. At Teamco, on the other hand, we saw in- 
stances of a wide range of literacy activities during the meeting of the Aeon 
team — and this was a relatively literacy-poor example compared with others we 
observed. Let me refer briefly to another meeting, this one by the wave-solder 
team. The beginning of this particular meeting was dominated by a few work- 
ers — the lead of the meeting and a technician who served as a self-appointed 
informal facilitator. Eventually, however, an invitation into the discussion — that 
is, into both the team’s immediate discussion and the larger ongoing discussion 
within the workplace — was explicitly extended to all of the team members when 
Carlos first brought to their attention the issues raised in a weekly quality meet- 
ing. The team members took up his invitation, especially when Carlos proposed 
and facilitated the construction of a fishbone diagram of one problem. Carlos 
exercised the authority he had as technician and team patriarch by first proposing 
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the brainstorming and diagramming and then facilitating it even after the team 
leader ignored the idea. His help we coded as coaching , or facilitating a literate 
activity or the understanding of a representation, a function of the meta-category 
participating in the flow of information. 

When Carlos raised the quality issue, the concern about solder balls; Yiheng 
joined the conversation for the first time, perusing and citing the quality report, 
signifying his familiarity with the assembly referred to in the report, and conjec- 
turing about the possible causes of the problem. Leon and Dai likewise took part 
in discourse around and about the text (in this case the quality report) and joined 
in the problem-solving effort, adding to the flurry of conjecture about causes. 
Hoang also entered the conversation, requesting and perusing the report. It was 
during this section of the meeting that Leon, always active in team discussions, 
began participating in new ways by providing linguistic assistance for Yiheng. 
Though this assistance was more obvious in later sections of the meeting, it began 
here with his miming particular processes as a way of helping Yiheng stay afloat 
in the conversation. 

The range of participation in the meeting increased during the formal brain- 
storming session (the fishbone diagram) and the subsequent listing of solutions to 
the brainstormed (or fishboned) causes of the solder-ball problem. For the most 
part, over the course of the meeting the team members’ participation fell into the 
meta-category taking part in discourse around and about text. As with the other 
meetings and events we analyzed, this was the most frequently used category— a 
full two-thirds of the more than 150 instances of literate activity in this meeting 
represented functions in this category, with team members repeatedly perusing 
and referencing the documents on hand and citing assemblies, their profiles, and 
machine settings and adjustments. But in this section of, the meeting, with the 
introduction of the formalized process, the perusals , the references , the citations 
took on a different weight, a different function. As part of the brainstorming, the 
team members helped to shape the lists and diagrams as they referenced them and 
then let these new representations shape their understanding of a work process. 
And so perhaps more significant than the several instances of taking part in 
discourse around and about text were these fewer instances of problem solving: 
specifically, six of the nine team members present participated to some degree in 
brainstorming , collaboratively constructing a representation for heuristic pur- 
poses. The brainstorming session was a swirl of literate activity, with workers 
constructing representations, clarifying proper categories for ideas offered, refer- 
encing items on the list, and citing a variety of representations and literate activi- 
ties, all this within the framework of a particular work process in which they 
variously participate. 

Thus, the workers in this meeting were offered an opportunity to participate 
as a group in troubleshooting the work processes they were a part of, while the 
frontline workers in the EMCO events were kept out of discussions of work 
processes and at a distance from texts. It is interesting to note that although the 
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lead, the technician, and the senior operator dominated the meeting, when the rest 
of the workers did participate, not only were they taking part in discourse around 
and about text, simply receiving instructions or requesting clarification , but with 
the help of a skillful facilitator such as Carlos, they were also participating to 
some degree in problem solving and in further understanding the larger work 
processes of which their particular tasks were a part. 

On the basis of such literacy analyses it is clear that, while literacy was 
everywhere at both factories, at Teamco more literate activities were expected of 
a wider range of workers. At EMCO the leads were the only frontline workers 
with any responsibilities for literate activity, while at Teamco virtually all work- 
ers were expected to develop literate sensibilities, and a rather impressive range 
of workers read, wrote, and talked about texts for a rather impressive range of 
purposes. 



Literacy Finding 3: Caveats and Qualifications 
Regarding Literacy Rights and Responsibilities 

The public discourse about high-performance work environments rarely ven- 
tures beyond blanket pronouncements on the benefits to be gained from self- 
directed work teams and the “learning organization” or uncritical praise for par- 
ticular factories that have chosen this route. In my research, though, I have been 
able to look deeply at the implementation of teams at a highly regarded company 
and in so doing to probe beyond the company’s public persona and to document 
problems and challenges as well as successes. In essence, what I found is that 
Teamco, despite its high-performance ideals, actually placed considerable con- 
straints on the exercise of literate abilities — because it placed serious constraints 
on workers’ rights and responsibilities in general. While claiming to empower its 
frontline workers, Teamco generally continued to maintain traditional roles and 
relationships between workers and management, and this established hierarchy 
shaped and constrained literacy practices. 

Earlier, in the context of information about the Aeon team meeting, I dis- 
cussed the ways in which the literate practices of teams were constrained. An- 
other place where traditional roles were most apparent at Teamco was the train- 
ing room, where workers went to learn how to participate in self-directed work 
teams. While the teacher of these classes generally engaged in activities in which 
literate functions spanned all of the meta-categories, students in the class were 
severely constrained in their literate activities. They recited; they received in- 
struction; they recounted; they completed forms; they did a bit of minimal ex- 
plaining around literate tasks. But in a class designed to induct them into self- 
directed work teams, they engaged in virtually no activities that required literate 
problem solving or that required them to exercise critical judgment. We would 
have thought the training classes, where workers momentarily escaped from time 
pressures and from what one manager called the “brutality” of the factory floor, 

134 




124 



MANUFACTURING THE NEW WORKER 



would have been the prime place for modeling, practicing, and trying on the new 
activities expected of team members, including activities leading to an identifica- 
tion with factory literacy, activities with numbers, forms, reporting, and the writ- 
ten word. But this was not the case. 

In the team presentations I analyzed, where frontline workers stood before 
management and offered up information on the data they had collected and ana- 
lyzed, I likewise expected to see a great deal of literate activity that could be 
categorized as problem solving or exercising critical judgment. But here, too, 
workers seemed fairly limited. Predominantly in these sessions, presenters used 
literacy to explain and to take part in discourse around and about text. Perhaps 
because these sessions were viewed early on as performances rather than as 
genuine dialogues between workers and management, there was small expecta- 
tion that workers would exercise those literate abilities associated with the right- 
hand side of our meta-category continuum and little incentive for them to do so. 



CONCLUDING THOUGHTS 

Previous studies of literacy at work — even qualitatively oriented ones — have 
been content with characterizing literate activities with broad brush strokes. One 
of the best-known early examinations of literacy at work — Diehl and Mikulecky 
(1980) — categorized literate activity as either reading to know or reading to do. 
These authors suggested that “reading to do” characterizes literate activity in the 
workplace, while “reading to know” is what children do mostly in school. 
Thereby, they usefully questioned the commonplace assumption that reading is 
reading is reading. In contrast to this early work is the taxonomy described in this 
chapter, which paints a more detailed and complete picture of the nature of 
literate activity at work than most studies to date. To be content now to say that 
reading at work in the main consists of “reading to do” is to overlook the many 
different functions that reading serves when people are reading in order to ac- 
complish a task, as well as to underestimate the importance and prevalence of 
literacy in the workplace. Moreover, the categories “reading to do” versus “read- 
ing to know” give no sense of the political nature of literate activities in the 
workplace. The kinds of literate activities that a person engages in at a workplace 
may have more to do with workers’ rights and responsibilities and the limits and 
constraints set by the company hierarchy than with the nature of the work per se. 
Thus, I believe that this study indicates how very important it is to be precise and 
detailed when describing the functions that reading and writing serve in the 
workplace and to be clear about how those functions relate to workplace hierar- 
chies and power structures. 

The study further illustrates, I believe, the value of ethnographic and qualita- 
tive research for understanding the skill requirements of work and, conversely, 
suggests the ways in which studies that are based primarily on survey data or 
“grand tours” of the workplace may be misleading. When we first began our 




135 



GLYNDA HULL 



125 



research at EMCO, the plant manager assured us that literacy was not very 
important at the factory and pointed out that most people there could not even 
read English. As I have demonstrated, he was wrong on both accounts. Even at 
Teamco, with its intense interest in the team concept, the role and importance of 
literacy went unrecognized. Yet we have seen that both factories were awash 
with paper and that at Teamco an important part of being an effective team 
member was developing what I have called a “literate identity.” 

The project also complicates the notion of high-performance work environ- 
ments. Appelbaum and Batt (1993) observed with a critical eye that the U.S. 
response to workplace innovation has been to try it piecemeal, adopting a few 
isolated practices associated with quality enhancement programs rather than the 
whole ball of wax. This characterization, while accurate for many companies, I 
am sure, does not quite get at the problems I saw surfacing at the high-perfor- 
mance factory. It is hard to imagine a much more whole-hog approach to reorga- 
nization around teams than Teamco’ s. What seems to be the case for that factory, 
and I suspect for others, is that it is quite possible for high-performance innova- 
tions such as self-directed work teams to coexist comfortably with Taylorist 
hierarchical work processes and Taylorist notions of how to introduce change. 
Teamwork at this high-performance company was directly connected with, and 
its success completely measured by, the improvement of quality and productivity 
rates. But this did not mean that workers performed their jobs differently or that 
the traditional plant hierarchy was rearranged or challenged. Those interested in 
workplace reform and high-performance innovation have a long row to hoe, both 
in implementing change and in understanding and circumventing resistance to it. 

In this paper I have illustrated the ways in which literacy is part of the texture 
of circuit board assembly. I would venture that similar portraits will emerge from 
research in other industries, since modern literacy requirements in manufacturing 
seem to be driven by an almost universal interest in and need for certification and 
recordkeeping. A new requirement for today’s world of work, then, is develop- 
ing a literate identity as a worker — becoming adept at and comfortable around the 
paperwork that is part and parcel of everyone’s work now on the manufacturing 
floor, learning to conceptualize one’s work in terms of its written representations, 
and being able to master and manipulate the social rules that govern literate 
activities in the factory. 

It is still customary to talk about literacy in terms of basic skills and to urge 
schools, vocational programs, and adult literacy classes to teach these fundamen- 
tals. But my research argues for a vastly different way of viewing workplace 
literacy. I have shown the remarkable variety and number of functions that 
reading and writing serve in circuit board assembly. What will also surprise 
people about this list is how small a portion of the functions fall into the category 
of “basic,” by which I mean relatively simple, self-contained tasks: copying, 
labeling, keyboarding, tallying. The continuum of literacy functions quickly 
expands first to include categories in which the purposes that literacy serves are 
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more complex using literacy to explain, taking part in discourse around text, 
participating in the flow of information, problem solving — and then to include 
categories in which literacy is more obviously connected with issues of power — 
using literacy in the exercise of critical judgment, using literacy to acknowledge, 
exercise, or resist authority. 

Workers don’t need just the “basics,” whether those basics are cast in a 
traditional mold of reading, writing, and arithmetic or recast as higher-order 
thinking skills or other decontextualized competencies posted on various skill 
lists. I have observed workers using literacy for purposes that run the gamut of 
the categories. Indeed, my argument is that a literate identity means being able to 
do precisely that — that is, to dip appropriately as needed into a wide and deep 
repertoire of situated ways of using written language and other forms of represen- 
tation in order to carry out a work-related activity. 

Happily, virtually all of the workers my research team and I observed were 
able to rise to the occasion. There was no literacy crisis at EMCO or Teamco. 
Despite having to traverse boundaries of culture, language, class, gender, ideol- 
ogy, and work hierarchy, these workers for the most part have taken on the 
challenge of developing a repertoire of literate practices, and they are meeting it 
successfully . 5 One need only recall the picture of the frontline worker, the recent 
immigrant, standing before a roomful of managers, reciting from her graphs and 
charts, to recognize and appreciate the task and the achievement. In fact, the 
most formidable challenge for workers is not, I would argue, developing a literate 
identity but being perceived as capable of doing so, being viewed as fit for the 
occasion. 

It is almost a truism of current literacy theory that reading and writing are 
connected to power, but rarely have researchers traced those connections empiri- 
cally. This project has demonstrated that particular functions for literacy — high- 
prestige functions such as those associated with exercising judgment and prob- 
lem solving — are most often associated with and available to those in positions of 
authority, such as supervisors, managers, and engineers. On the other hand, 
certain other functions that literacy serves — lower-prestige purposes such as ac- 
complishing simple, discrete tasks or using literacy to explain — are most often 
the categories associated with and available to frontline workers. Taking part in 
literate activities is not always so much a question of ability, then, as it is a 
question of rights and opportunities. In other words, patterns of literacy use are 
generally linked to structures of authority. What this means, practically speak- 
ing, is that skills change when authority changes. Thus, one reasonable measure 
of whether a factory is truly high performance — whether workers are actually 
imbued with the power to solve problems and to direct themselves — lies in the 
types of literacy workers are able to practice. 



5 Exactly how they did so, how workers organized themselves individually and collectively to get 
their work done, including literacy-related tasks, will be the topic of a future paper. 
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APPENDIX 5-A: ACON TEAM EXPLAINS ITS LOW 
PRODUCTIVITY* 



Researcher: 

Xuan: 

Woman: 

Researcher: 

Eva: 

Xuan: 

Mai: 

Xuan: 

Eva: 

Mai: 

Xuan: 

Eva: 

Mai: 

Eva: 

Mai: 

Eva: 

Mai: 

Eva: 

Mai: 

Researcher: 

Woman: 

Researcher: 

Mai: 

Eva: 

Researcher: 



It’s still fifty=six= 

=But= this week- this week had 1 day is fifty-seven, right? 
=Yeah= 

=Ah, why?= Ah, why?== 

==Why? 

Becau- ... us don’t have job, right? 

Yeah [rapid speech] (Le-=e-e-e-he)= 

=Acuson= board 
==Oh:: yeah== 

==Acuson board== 

==[xx]== very slow 
Yeah:: 

One hundred twenty 
We did a= 

=wh-= 

=Acuson board I think== 

==1 hour -1 hour= 

=Wednesday= 

[rapid speech] Twenty boards -an hour= 

=Ah, when you- said you did twenty boards -that day= 
=[laughter]= 

==Is that the day you’re talking about? The day you -did 
twenty= 

=[xx]- First number wa- was -[xx]= 

=No, that’s- different this week 

Oh, this week. Oh, oh, oh, -that was last week= 



*See the section “Operator Brain Dead: A Reading Problem at Teamco” for an explanation of 
transcription conventions used here. 
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Xuan: 

Eva: 

Mai: 

Eva: 

Researcher: 

Xuan: 

Mai: 

Xuan: 

Mai: 

Xuan: 

Mai: 

Eva: 

Hoa: 

Xuan: 

Eva: 

Mai: 

Eva: 

Mai: 

All: 

Researcher: 

Eva: 

Woman: 

Researcher: 

Eva: 

Researcher: 

Eva: 

Researcher: 

Eva: 

Researcher: 

Eva: 

Researcher: 

Hoa: 

Researcher: 

Woman: 

Xuan: 

Eva: 

Mai: 

Woman: 

Mai: 



=1 think we did sixty- twenty boards== 

==We didn’t have boards= because the melting machine was 
down= 

=[xx]= 

=and they let us do the Acuson board, and we spent- I don’t 
know how many hours we did their board 
Isn’t- you don’t -usually do Acuson-= 

=(They give us)- 2 hour- you’re not- overtime 2 hour they have 
eighty boards, but us how many, how-== 

==One hundred twenty 

One hundred twenty, but how-==how long= 

=how hour= 

=How long?= 

I don’t know how long 
I remember it== 

==may- =maybe it’s-== 

==5 hour 
=5 hour, yeah= 

= maybe it’s 5= =maybe 5= 

=maybe 4 to 5 hour= 

=maybe so: 

[laughter; comments in Vietnamese] 

Why though? I mean- 

Because it’s- there so many defect boards= 

=[Vietnamese] 

You’re not used to doing that?== 

==No, because that’s- this is Acuson board == 

==Oh:, so you don’t =do that Acuson boards 
=it’s not our boards 
It’s not =what you= 

=We’re just trying= to help it because we don’t have any board 
to do 

So it took you a long time; that made your productivity low 
Yeah 

Would- Hmm== 

==[high pitched] Yeah 
So== 

==[ Vietnamese] [.03] 

Just how- how many person? 

=ten= 

=one= 

[Vietnamese] 

One, two, =three, four,= 
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Xuan: 


=Acuson boa-= 


Mai: 


==five. five== 


Xuan: 


==five people== 


Mai: 


==five people 


Xuan: 


Nah: =[Vietnamese]= 


Mai: 


=five people [Vietnamese]= 


Researcher: 


Oh, Acuson usually has seven== 


Mai 


==Yeah [xx] 


Researcher: 


And you- just five of you guys 


Mai: 


Yeah =[Vietnamese]= 


Xuan 


=[Vietnamese]= 


Mai: 


Twenty, twenty, twenty, twenty-one== 


Eva: 


==transistor- twenty pieces of transistor= 


Woman: 


=Oh::= 


Eva: 


=you have to put masking on it, and= 


Researcher: 


=Oh= 


Eva: 


=[xx]= 


Xuan: 


=each one= but it’s hard, you know. Y< 
(straight). If you (fall down) like that you 


Eva: 


==That’s why we’re very very slow= 
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APPENDIX 5-B: TAXONOMY OF FUNCTIONS OF LITERACY 





AT EMCO AND TEAMCO 


Literacy Codes 


Description 


Actioning 

Admonishing 


Accepting or assigning responsibility by committing in writing. 
Admonishing an individual or group about possible or actual violations 
of documented procedures. 


Analogizing 


Comparing representations, processes, or activities in order to illustrate 


Assessing 


a point or to facilitate understanding. 

Assessing an individual s or group’s understanding of a representation 
or literate activity. 


Assigning 

Bestowing 

blessings 

Brainstorming 


Assigning responsibility for authoring a representation. 

Declaring a literate activity good and worthy of time spent. 

Individually or collaboratively constructing a representation for heuristic 
purposes. 


Calculating 


Doing calculations (whether adding and subtracting or figuring standard 
deviations) not in service of one’s self but as an integral part of 
literacy-related problem solving (e.g., for setting, adjusting, or 
justifying production schedules or team goals). 


Categorizing 

Certifying 


Sorting something in order to classify. 

Using a representation to attest to an individual’s particular 
competence(s). 


Citing 


a) Referring to a representation that is not at hand; b) referring to a 
literate activity not at hand. 


Coaching 
Completing forms 
Conjecturing 
Constructing rules 


Facilitating a literate activity or the understanding of a representation. 
Completing routine forms. 

Inferring, theorizing, predicting, or guessing based on limited data. 
Constructing a rule regarding the use or interpretation of a 
representation or literate activity. 


Contextualizing 


Providing an historical or situational context for a representation or 
literate activity. 


Copying 


Copying a representation from one medium to another without 


Correcting 

Creating 

hypotheticals 

Critiquing 


qualitatively changing the representation. 

Ridding a representation of errors. 

Creating a hypothetical comparison of representations or literate 
processes or activities. 

Showing or expressing disapproval of or finding fault with a 


Deferring 


representation or literate activity. 

Yielding to the opinions or direction of another regarding a 
representation or literate activity. 


Demonstrating 


Demonstrating a literate activity for purposes of explanation, 
clarification, or instruction. 


Disputing 


Questioning, doubting, debating, and/or resisting the opinion or direction 
of another regarding a representation or literate activity. 


Dramatizing 


Explaining a representation or literate process by using a fictionalized 
example. 


Elaborating 


Explaining a representation by drawing upon details not present in the 
representation. 


Evaluating 


Evaluating the quality of a representation or literate activity. 



GLYNDA HULL 



131 



Literacy Codes Description 



Exhibiting 

Explaining 

Fudging 

Gaining consensus 
Gauging reaction 

Giving direction 

Giving instruction 

Giving a show- 
and-tell 
Granting 
permission 
Highlighting 
Identifying 
Illustrating 
Inferring 

Interpreting 



Invoking 

Irony 

Justifying 

Keyboarding 

Labeling 

Locating 

Looking 

something up 
Matching 
Miming 
Note taking 



Perusing 

Planning 

Practicing 

Presenting 
Problem solving 

Proofreading 



Demonstrating a point by passing around a sample representation, as in 
show-and-tell. 

Using or referring to a representation or literate activity in explaining 
something to another person. 

Creating a deliberate misrepresentation. 

Gaining and recording group agreement. 

Considering alternate interpretations of, reactions to, and potential fall- 
out from problem solutions. 

a) Writing directions for what to do; b) telling another what to do with 
respect to a literate activity. 

a) Writing instructions for how to do something; b) Telling another how 
to go about a literate activity. 

Demonstrating by passing around a sample representation, as in show- 
and-tell. 

Granting permission to alter or transfer a controlled representation or to 
revise or engage in an alternative to a controlled literate activity. 

Emphasizing an aspect or aspects of a representation or literate activity. 

Matching the physical with the representation. 

Using a representation to illustrate a point. 

Inferring or predicting consequences based on an understanding of 
causes and effects. 

Understanding a representation in terms of its purpose or function a) 
within a work process or b) within the organization’s hierarchical 
structure. 

Invoking an organizational rule, script, procedure, or personal 
understanding of how to carry out a literate activity. 

Drawing on understanding of another literate function to make a joke. 

Drawing on forms of representation to justify a course of action. 

Entering any type of information using a keyboard. 

Creating a representation in order to identify. 

Looking for a particular representation, which should exist, to satisfy a 
particular function. 

Finding information in a document. 

Checking that a physical item and a representation match. 

Gesturing to represent another representation or a literate activity. 

Taking notes during work processes, class, or training for personal 
reference later, (Notes may serve any of a variety of functions, 
including highlighting, translating, reminding, simplifying, and 
correcting.) 

Reading or studying a representation. 

Working from a representation to plan a course of action. 

Participating in literate activity solely for purpose of becoming 
proficient at process; “product” not intended for use. 

Using a representation to structure an oral presentation. 

Drawing on literate and/or numerate resources in conjunction with 
background knowledge to construct a problem solution. 

Scanning a representation for errors. 
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Literacy Codes Description 



Proposing 

Protecting 

Providing 

linguistic 

assistance 

Quoting 

Receiving 

instruction 

Reciting 

Recording 

Recounting 

Referencing 

Reflecting 

Representing 
Reprimanding 
Requesting action 
Requesting and/or 
providing 
clarification 
Requesting 
documentation 
Requesting 
permission or 
approval 
Revising 
Role playing 

Seeking direction 
Seeking instruction 

Signifying 

Summarizing 

Tallying 



Translating 

Validating 

Verifying 



Creating a representation to propose an idea or course of action or 
proposing the creation of a representation as a course of action. 
Using a document to protect oneself from blame — assigning 
responsibility to another, documenting course of action, etc. 
Aiding someone in decoding and/or pronouncing written material. 



Drawing on or invoking company discourse to legitimate an idea, 
suggestion or position. 

Receiving instruction on how to do something. 

Reciting from a written text (e.g., blackboard, workbook, flipchart, 
overhead). 

Making note of an action. 

Reviewing, with some narrative detail, a literate activity. 

Referring to representations, literate activities or processes at hand. 

Reflecting on some aspect (e.g., process, intention, efficacy) of a literate 
activity some time after the activity has been completed. 

Creating a representation of something else. 

Writing a document that can have a disciplinary consequence. 

Writing something to request action from another. 

Requesting and/or providing clarifying information about a 
representation or literate activity. 

Requesting a representation for use or perusal. 

Requesting permission to alter or transfer a controlled representation or 
to revise or engage in an alternative to a controlled literate activity; 
requesting approval of such an alteration. 

Modifying or updating a process or document. 

Taking on the role of another person in order to enact a scripted 
hypothetical work scenario. 

Seeking direction from some authority in carrying out a literate activity. 

a) Seeking written instructions; b) seeking instruction from another in 
how to carry out a literate activity. 

Matching up two signs for the same object. 

Recapping the content of a representation or using a representation to 
recap a process or activity. 

Doing calculations to serve limited literacy-related ends (e.g., to 

complete forms) in isolation from the larger problem-solving contexts 
for which the data will be used. 

Translating from one representation to another. 

Sanctioning an idea or action proposed in or through a representation. 

Checking one’s understanding of a representation, literate process or 
activity. 
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Twenty-First Century Measures for 
Twenty-First Century Work 

Kenneth Pearlman 



INTRODUCTION 

This paper explores the possible roles of assessment in promoting and facili- 
tating the development of skills required in the emerging world of work. The 
paper draws heavily on earlier work (Pearlman, 1993, 1994a, b) and develops the 
following basic arguments: 

1. Skill is not a singular or unitary concept. There are a number of skill 
types with differing implications for how we conceptualize skill gaps and skill 
transferability. 

2. The meaning and value of work in the twenty-first century, especially in 
emerging high-performance organizations, will be increasingly dependent on 
emerging theories of job performance and on the meaning of the term “contextual 
performance.” Contextual performance (as distinct from job-specific, technical or 
task performance) involves activities that, whether or not they are formally pre- 
scribed (part of a job description), are not specific to a particular job or area of 
work specialization but rather support the organizational, social, and psychologi- 
cal environment in which job-specific or technical or task performance occurs 
(see also Resnick, Chapter 11, this volume). This definition encompasses such 
activities as facilitation of peer, team, or unit performance; commitment to, pro- 
motion of, and generation of enthusiasm for organization or unit goals, practices, 
and policies; organizational “citizenship” or image — enhancing behavior; and 
various forms of prosocial, service — oriented, or organizational commitment be- 
havior, which simultaneously implies the avoidance of behavior that would harm 
the organization or work unit. In other words, contextual performance is the 
“surround” of what we have traditionally thought of as “real” job performance. 
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As the emerging workplace increasingly blurs distinctions among jobs, and 
even threatens the very concept of a “job” (Bridges, 1994; Pearlman, 1995), 
contextual performance becomes increasingly important to organizational sur- 
vival — i t i s the organizational analog of the medium becoming the message. 

3. Cross-functional skills such as teamwork, communication, leadership, 
coaching/mentoring, conflict management, negotiating, customer service, deci- 
sion making, managing resources, and information gathering and analysis are 
among the most important for effective contextual performance and employment 
stability and security for workers. Unfortunately, such skills are also the most 
problematic to define, assess, and develop, largely due to the absence of rigorous, 
comprehensive, work-analytic or construct-oriented research on such skills. There 
is as yet no systematic mapping of such skills to either the content or the context 
of the emerging workplace. 

4. The utility of programs and initiatives designed to shape and motivate the 
education, training, or development of the skills and knowledge needed in the 
emerging workplace depends on research and information that is incomplete in 
several key respects, such as the relative importance and the relative trainability 
of different types of skills. 

5. The above points present numerous challenges for assessment, the most 
urgent of which is the need for technically sound and widely deployable mea- 
sures of cross-functional skills. On a system level, there is a need for better 
integration of the three conventional roles of assessment: diagnosis (enabling 
inferences regarding what has and has not been learned); prediction function 
(enabling inferences regarding future performance or behavior); and evaluation 
(enabling inferences regarding level, status, or progress of either individuals or 
institutions, which can influence the degree and direction of individual and insti- 
tutional investment in skill, knowledge, and ability development). 

The remainder of this paper builds toward a vision of twenty-first century 
assessment that links four key themes: the changing demographic and organiza- 
tional context of work, changing concepts of skill and competence, the need to 
map changing skills definitions to changing definitions of work, and the resultant 
(and formidable) challenges to assessment posed by these changes. To set the 
stage for this analysis, I begin with a brief review of the legislative, policy, and 
research contexts. 



BACKGROUND 

ITEM: A report issued recently by the National Association of Secondary 
School Principals (1996) proposed that an employer dissatisfied with a recent 
high school graduate’s job performance should be able to send the employee 
back to high school for additional training. This was one of several recommenda- 
tions for sweeping structural changes in our education system included in their 
study, Breaking Ranks: Changing an American Institution. The report states that: 
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buyers can get [faulty products] fixed or replaced if they do not work properly. 

We understand the difference between inanimate objects and human beings, but 
that does not excuse high schools from the obligation to guarantee the quality of 
the young people they educate. 

The report said that personnel managers often complain about the deficien- 
cies of 18 and 19 year olds who cannot do simple arithmetic and lack basic 
writing skills. Forcing the schools to guarantee their “product” — symbolized by 
the diploma — would encourage them to raise their standards for graduation. A 
dissatisfied employer could file a complaint with the high school. If the young 
person’s education was deficient by entry-level standards, the high school would 
have to provide additional training or arrange for the graduate to attend classes at 
a local community college or in a special remedial program. 

ITEM: In a speech at an October 1993 Business for Social Responsibility 
Conference, the renowned Massachusetts Institute of Technology economist 
Lester Thurow expressed his ambivalence about Motorola University, widely 
regarded as one of the best-private sector training enterprises in the country: “On 
one level,” he said, “I think it is the most fantastic thing any big company has ever 
done in America. On another level, it tells the local school system, ‘You don’t 
have to perform because even if you turn out a lousy product, we’ll re-educate 
them later,’ so you deliver a very bad signal to the system.” Thurow cited the work 
of John Bishop at Cornell University, who has argued against the use of the 
Scholastic Aptitude Test (SAT) for making college admissions decisions in favor 
of wide-range achievement tests and Advanced Placement tests (Bishop, 1988). 
Bishop holds that use of the SAT by colleges and universities gives American 
high schools an excuse for failure by, in effect, sending the message that no matter 
how poor a job has been done by the K- 12 education system, a student with a high 
IQ will be accepted anyway. Thurow argues, as does Bishop, that universities 
should insist that high IQ is not a substitute for performance and should let high 
schools know that they will be judged on performance, not whether they have 
high-IQ students. Thurow went on to make the point that it is only through well- 
conceived and well-designed systems , and systematic national efforts to change 
our philosophy and approach to education and training in this country that we 
will be able to begin to offer the type of “product guarantee” now increasingly 
being sought by employers and educators alike. 

ITEM: A recent report of a survey of New Jersey employers conducted for 
the New Jersey Business-Higher Education Forum (Van Horn, 1995:22-23) con- 
cluded that: 

there is wide agreement that more must be done to strengthen the bond between 
higher education and employers. Many employers say they are having difficulty 
hiring college graduates who have the skills they need. Employers are placing 
greater emphasis on teamwork, communications skills, problem-solving, and cre- 
ative thinking. Business people often say that faculty members do not know 
enough about the world of work and are thus ill-prepared to teach necessary work 
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skills. . . . Many postsecondary institutions are responding to employers’ con- 
cerns, but significant resistance persists. Leaders from higher education complain 
that employers do not adequately communicate what they need from college 
graduates. . . . 

Some academics resent what they regard as crass attempts to transform colleges 
and universities into “vocational schools” and to subvert the nobler purpose of 
education for its own sake. Suspicion and resentment are fueled because the 
pressure for greater higher education/workplace connections is coming primari- 
ly from business leaders and politicians rather than from the faculty and aca- 
demic administrators. . . . Significant progress has been made on the crucial 
step of stipulating the knowledge, skills, and abilities vital to employers. A 
consensus is emerging on the basic elements. Efforts by industrial sectors to 
specify clusters of necessary skills are promising and could contribute lessons 
for other areas of the economy. Less progress has been made on assessing the 
performance of college students in acquiring the skills and abilities desired by 
employers. Designing such measures is difficult and also problematic because 
many of the desired skills and abilities are not taught in colleges and university 
classrooms and laboratories. . . . Questions still must be resolved about what 
should be taught in schools, what should be taught on the job, and what cannot 
be taught at all. 

These represent but a few of the most recent examples of a series of alarms 
that, beginning with the widely cited 1983 report A Nation at Risk: The Im- 
perative for Educational Reform (National Commission on Excellence in Edu- 
cation, 1983), have been sounded over the past 15 years by various federal and 
state governments, special commissions, and task forces (Johnston and Packer, 
1987; National Center on Education and the Economy, 1990; National Gover- 
nors’ Association, 1992; Secretary’s Commission on Achieving Necessary 
Skills [SCANS], 1991). These reports reflect a widely perceived national cri- 
sis — the growing gap between the demands of a new American workplace 
driven by the emerging global economy and the supply of workers who possess 
the skills and knowledge to function effectively in such a workplace. It is a 
crisis that has called into question the efficacy of our education system — both 
K-12 and postsecondary education — as well as the way we assess the capabili- 
ties of individuals and the effectiveness of educational and training institutions. 

At the national level, this crisis has been the impetus for a number of federal 
initiatives over the past several years, each directed in one way or another toward 
remediation of America’s perceived “skills gap” and the attainment of “a high- 
performance economy — one characterized by high skills, high wages, and full 
employment — in which every human being’s resources are put to their best use” 
(SCANS, 1992). 

Secretary’s Commission on Achieving Necessary Skills 

The Secretary’s Commission on Achieving Necessary Skills (SCANS) was 
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chartered as one aspect of the “America 2000” strategy to achieve a set of na- 
tional goals in education agreed to by the president and the nation’s governors 
(SCANS, 1991, 1992). SCANS was asked to examine the demands of the work- 
place and the capacities of young people to meet those demands. Specifically, it 
was asked to define the skills needed for employment; to propose acceptable 
levels of proficiency in those skills, to suggest effective ways to assess profi- 
ciency; and to develop a dissemination strategy for the nation’s schools, busi- 
nesses, and homes. SCANS found that more than half of the nation’s students 
leave school without the knowledge or foundation required to obtain and hold a 
good job. This is directly attributed to the workplace changes that have resulted 
from globalization and new technology growth, creating conditions that have 
fundamentally changed the terms for entry into the workplace. 

The centerpiece of the SCANS work is the delineation of a set of five “compe- 
tencies” (productive use of resources, interpersonal skills, information, systems, and 
technology) and three categories of “foundation skills” (basic skills, thinking skills, 
and personal qualities) believed to lie at the heart of job performance and to reflect 
essential preparatory requirements for all students, both those going directly to work 
and those planning further education. The vision was for this work to constitute the 
blueprint that would drive needed changes in education (curriculum development, 
school organization, teacher training, and instructional materials and technology); 
the workplace (work-based learning, public-/private-sector training coalitions), and 
associated assessment systems (a national assessment system that helps students 
understand what they need to learn and that certifies achieved levels of the SCANS 
skills and competencies). An ongoing National Job Analysis Study is being con- 
ducted by American College Testing to pursue further validation and elaboration of 
the SCANS framework (American College Testing, 1994). 



Advisory Panel for the Dictionary of Occupational Titles 

The Advisory Panel for the Dictionary of Occupational Titles (APDOT) was 
chartered in 1 990 to recommend to the secretary of labor strategies for collecting, 
analyzing, and disseminating occupational information to revise or replace the 
aging Dictionary. This initiative, like SCANS, grew out of the recognition that 
investment in people’s skills and restructuring of workplaces into high-perfor- 
mance organizations were critical to our country’s ability to remain competitive 
in today’s global economy. Moreover, it was recognized that the development of 
a national occupational information system — one that provided a common lan- 
guage for describing both people (i.e., skills, abilities, and knowledge) and work 
(both content and context) — was in turn an essential requirement for meeting 
such needs. A major output of APDOT was a “content model” (see Appendix) that 
provides, in some detail, a framework or taxonomy, for the collection, assessment, 
and dissemination of occupational information that is both worker oriented 
(skills, knowledge, abilities) and work oriented (work tasks and outputs, as well 
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as the surrounding work, organizational, and labor market context) (APDOT, 
1993). APDOT 1 s vision was that this content model, when fully operationalized 
and deployed in the form of an automated database available in multiple media 
and formats, would form the basis for a national occupational information infra- 
structure, based on a common language of person- and work-related information, 
that would support a myriad of applications and work-force investment strategies 
involving skill and knowledge development, education, assessment, and voca- 
tional and career counseling. A prototype of this system, covering about 20 
percent of the occupations in the U.S. economy, is nearly complete (American 
Institutes for Research, 1995). 

Goals 2000 and Skills Standards 

In 1994 the Clinton administration launched a collaborative effort between 
the U.S. Departments of Labor and Education to promote the development of a 
nationwide system of voluntary, industry-based skill standards. The Goals 2000: 
Educate America Act established a National Skills Standards Board to encourage, 
promote, and assist partnerships representing business, labor, educators, and oth- 
ers in the development of industry-related skill standards. This initiative was an 
outgrowth of the recognition that there is currently little systematic connection 
between the skills needed in the workplace and those imparted through education 
and training. The problem is exacerbated by the limited range of nationally 
recognized credentials. These problems result in increased hiring and training 
costs, restricted employment opportunities, lack of quality assurance, and a direct 
threat to the country’s ability to compete effectively in the emerging and rapidly 
changing global economy. 

The stated purpose of a national system of industry-based skill standards 
is to identify the knowledge, skill, and ability levels needed for successful 
workplace performance. Such a system would also ensure a common, standard- 
ized way to classify and describe the skills needed for particular occupations 
and would utilize a variety of evaluation techniques to assess the skills pos- 
sessed by individual workers. In so doing, it would aid communication among 
employers, educators, trainers, and workers regarding specific skill levels and 
needs and would ensure that workers have the portable skills required in today’s 
dynamic economy. The development of broadly defined skill standards is 
viewed, in the words of then-Labor Secretary Robert Reich (1991), as “the 
cornerstone of [a] work force development system,” which, when linked to 
educational standards, “will help create a seamless system of lifelong learning 
opportunities with certificates of mastery and competency that are accepted 
and recognized by employers” and which will “enhance America’s ability to 
match skills and jobs.” 

There are many anticipated advantages of a system of voluntary, 
industry-driven skill standards and certification. For industries it would be a 
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vehicle to inform training providers and prospective employees of the skills 
required for employment. For employers it would reduce the costs and legal risks 
associated with the assessment of job candidates and would make employment 
decisions more objective. For unions it would increase members’ job security 
through access to competency-based training and certification. For workers, it 
would protect against dislocation, enable them to pursue career advancement, 
and enhance their ability to reenter the work force by having a work portfolio that 
is based on training to industry standards. It would help trainers and educators 
determine appropriate training services to offer. It would help government to 
protect the integrity of public expenditures by requiring that employment-related 
training meet industry standards where they exist. 

The fundamental challenge of Goals 2000 is how to most effectively ensure 
that today’s and tomorrow’s students and workers can acquire and maintain the 
skills necessary to be productive in a rapidly changing workplace and thereby 
contribute to the country’s continued competitiveness in the emerging global 
economy. To accomplish this, Goals 2000 has adopted the strategy of building a 
national system of skill standards and skill certification intended to focus, moti- 
vate, and reward the skills that are to be learned on the job, in training, and in 
school. It has further adopted the strategies of addressing this issue using (1) job 
families or occupational clusters, as opposed to individual jobs or occupations, as 
the primary units of analysis within which skill standards and certification criteria 
would be developed and (2) skills that are sufficiently broad so as to be transfer- 
able across relatively wide ranges of work. 



SchooI-to-Work Opportunities Act 

The 1994 School-to-Work Opportunities Act provides seed money to states 
and local partnerships of business, labor, government, education, and commu- 
nity organizations to develop school-to-work systems. Rather than creating a 
government program, the intent of this law is to establish an infrastructure for a 
national system based on existing models of school-to-work transition, such as 
career academies, youth apprenticeships, technical preparation, and cooperative 
education. The law allows states and their partners to work together in efforts at 
education reform, worker preparation, and economic development to create a 
system that will prepare young people for the high-wage, high-skill jobs of the 
emerging twenty-first century workplace. The legislation prescribes no single 
model of how to accomplish this; rather, it encourages states and their partner- 
ships to design school-to-work systems that make the most sense for them. 
However, all such systems would share the common goal of providing every 
American student with (1) relevant education (allowing students to explore dif- 
ferent careers and see what skills are required in different work environments), 
(2) skills (obtained from structured training and work-based learning experi- 
ences), and (3) valued credentials (establishing industry-standard benchmarks 
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and developing education and training standards that ensure that proper educa- 
tion is received for each career). 

In addition, the legislation sets forth three elements viewed as fundamental 
to efforts to create a national school-to-work system: school-based learning, work- 
based learning, and connecting activities. School-based learning involves cur- 
riculum restructuring so that students can see the relationship between academics 
and work. It includes such elements as project work in teams, teacher-employer 
interaction, and workplace-relevant interdisciplinary teaching. Work-based learn- 
ing involves (1) employer-provided learning experiences to develop broad trans- 
ferable skills and (2) the study of complex subject matter and important work- 
place skills (e.g., teamwork, problem solving, meeting commitments) in a real-life 
“hands-on” environment that provides feedback and mentorships. .Connecting 
activities include program coordination and administration, school and business 
staff exchanges, and career counseling. 

The above initiatives address the challenge of how best to ensure the contin- 
ued competitiveness of the American economy in the global marketplace through 
investment in a highly competent, knowledgeable, skilled, and flexible work 
force. Central to all of these initiatives are issues of skills, skill transferability, 
skill standards, changes needed in our systems of education and training, the 
nature of work and work performance, and the role of assessment. Significantly, 
each of these initiatives, implicitly or explicitly, recognizes the need for systems 
that integrate and leverage these elements in an optimal way. This implies the 
need for theories, conceptual models, or frameworks by which the nature of these 
elements and their interrelationships can be understood. 

SKILLS 

Skill is not a unitary concept. In fact, there is currently no single, generally 
accepted definition of “skill” in the professional or scientific literature. The term 
has been used to refer to a wide range of personal characteristics, traits, work 
preferences, broad aptitudes, basic abilities, generic competencies, specialized 
skills, and specialized knowledge, creating a contemporary tower of Babel in that 
the same terms are often used to denote different classes of skills and different 
terms are often used to denote the same classes of skills. This lack of an accepted 
vocabulary or a “common skills language” has been a major obstacle to develop- 
ing appropriate strategies for addressing many critical skills issues, such as trans- 
ferability, gaps, and the setting of standards. 

As one example of this problem, consider the lack of clarity that permeates 
many current discussions of the growing “skills gap” in this country, a term used 
to refer to the difference between the demand for and the supply of “work-ready 
people. At times the skills gap involves or implies problems in fundamental 
aptitudes or abilities (e.g., seen as current work-force literacy and numeracy defi- 
ciencies). At times it involves problems in relatively generic or cross-functional 
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skills (e.g., seen as the need for greater degrees of interpersonal, teamwork, and 
decision-making skills among production workers who have been reorganized 
into semiautonomous teams). And at times the gap refers to problems in very 
specialized skills or knowledge (e.g., seen as the need for workers to become 
knowledgeable about and proficient in the use of new technology). More re- 
cently, it has become apparent that the gap of greatest concern to many employers 
is not about skills at all but about attitudes and personal qualities, such as integ- 
rity, reliability, and dependability (Cappelli, 1995; National Center for the Edu- 
cational Quality of the Workforce, 1994; Zemsky, Chapter 3, this volume). The 
lack of clarity and specificity about the origins and meaning of the concept of a 
skills gap makes it difficult to propose appropriate corrective policies. 



Multiple Categories of Skills 

This problem was recognized in the content model developed by APDOT 
and shown in the Appendix. The model defines the specifications for a compre- 
hensive occupational information infrastructure intended to have utility for mul- 
tiple work-force investment initiatives. Rather than attempting to define skills in 
a unitary fashion, the content model proposes a set of five categories of skills- 
related information as a provisional framework for defining and understanding 
the full range of attributes commonly referred to as skills. These five categories 
are (1) aptitudes and abilities, (2) workplace basic skills, (3) cross-functional 
skills, (4) occupation-specific skills, and (5) occupation-specific knowledge. An 
additional category, personal qualities (defined as “an individual’s characteristic, 
habitual, or typical manner of thinking, feeling, behaving, or responding with 
respect to oneself, others, situations, or events) was not considered by APDOT as 
part of the set of skills-related information descriptor categories because it refers 
to personality traits, values, and attitudes rather than skills per se. It is, however, 
potentially relevant to the present discussion. 

These skills-related information categories can be conceived of as a con- 
tinuum that varies in the level of description and application. At one end of the 
continuum are the very general and relatively few aptitudes, abilities, and basic 
workplace skills, consisting of perhaps 15 to 30 elements, that are expected to be 
applicable to very wide ranges of jobs. At the other end of the continuum are the 
fairly specific and relatively many occupation-specific skills and occupation- 
specific knowledge, consisting of thousands of elements, that are expected to be 
applicable to relatively narrower ranges of jobs. The cross-functional skills repre- 
sent a moderate level of generality and a moderate number of elements (perhaps 
30 to 50), and encompass skills that are expected to be applicable to relatively 
wide ranges of jobs but that fall far short of the presumably near-universal appli- 
cability of such basic workplace skills as reading and writing. The human at- 
tributes denoted by such terms in fact differ in a number of important ways, as 
discussed below. 
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How Broadly or Narrowly Attributes Are Defined and Described 

Skills-related attributes vary in the degree of generality or specificity with 
which they are defined. For example, verbal ability represents a broader level of 
description than reading comprehension skill, which in turn represents a broader 
level of description than the ability to read and understand corporate real estate 
contracts. Similarly, skill at carpentry represents a broader level of definition 
than skill at inside finishing, which in turn represents a broader level of definition 
than skill at hanging interior doors. 

Applicability and Relevance (or Transferability) Across Different Jobs 

Different classes of attributes also differ in terms of their applicability and 
hence transferability (or portability) across jobs and job families. For example, a 
skill such as organizing and prioritizing work tasks is obviously applicable to a 
much wider range of jobs than such a skill as repairing watches. Basic skills such 
as reading and arithmetic computation are nearly universally applicable, whereas 
highly specialized knowledge, such as knowledge of the physical properties of 
solenoid magnets, is relevant to very few jobs. 

Modifiability or Trainability of the Attribute 

A skill or attribute’s trainability refers to how well it lends itself to being 
learned quickly or to higher degrees, successfully transferred from the learning 
setting to the application setting, and retained over time. There is evidence that 
personal qualities (personality traits, values, and attitudes) and general apti- 
tudes and abilities are trainable or modifiable to very limited degrees and only 
with substantial investments of time and effort (Ackerman and Flumphreys, 
1990:260; Gottfredson, 1986b:386-389; Humphreys, 1989). Basic workplace 
skills, cross-functional skills, and occupation-specific skills and knowledge, on 
the other hand, are, by definition, acquired and hence trainable but within limits 
defined by an individual’s degree of general aptitudes and abilities and posses- 
sion of the particular personal qualities that underlie or are related to the at- 
tribute to be trained (Hunter, 1986). In addition, the trainability of such skills 
varies as a function of their complexity, with simpler, less abstract knowledge 
and more routinized skills more readily trainable than more complex, more ab- 
stract knowledge and more dynamic or adaptive skills, such as those that require 
frequent or constant adaptation to changing situations or conditions (Ackerman, 
1987; Kanfer and Ackerman, 1989). 

Applicability or Relevance of an Attribute to Different Settings or 
Purposes 

Not all types of attributes are equally applicable or relevant to different 
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purposes. For example, in the employment domain it is appropriate to use mea- 
sures of aptitudes and abilities and/or basic workplace skills to select among 
inexperienced applicants (such as recent high school graduates) for jobs in which 
they will receive subsequent company training (e.g., entry-level computer pro- 
gramming). This is because the goal in such a situation is to identify individuals 
with the highest capacity or potential for mastering the training. It would make 
no sense to test programming skill or knowledge in such a situation. On the other 
hand, a test of programming skill or knowledge (i.e., a measure of developed skills 
or knowledge) would be appropriate for selecting among applicants with prior 
computer programming experience for higher-level programming positions. As 
another example, Bishop (1988) has argued that measures of developed skill and 
knowledge are more effective incentives for learning than are aptitude measures. 
In addition, various categories of skills-related information also differ in the 
degree to which they lend themselves to the setting of skill standards and the 
establishment of skill certification criteria. There is evidence to support the view 
that both meaningful definition of a particular attribute and meaningful determi- 
nation of an appropriate required level of that attribute (e.g., to certify attainment 
of some established performance or knowledge level) are more feasible for fairly 
specialized skills or knowledge than for more general attributes, such as aptitudes 
and abilities, personal qualities, and cross-functional skills. 



The Manner in Which Attributes Can Be Measured 

There is a wide variety of methods and techniques by which human attributes 
can be measured or assessed. These include paper-and-pencil tests, physical ability 
tests, performance tests, assessment centers and job simulations, work samples, inter- 
views, structured training and experience evaluations, trainability tests, personality 
tests, direct job performance observation and assessment, direct training performance 
assessment, education or training course grades, level of education, amount of expe- 
rience or seniority, and work product assessment. Such techniques, however, are not 
equally applicable to different categories of worker attributes. For example, paper- 
and-pencil tests, which can provide reasonably good measures of certain kinds of 
specialized factual knowledge, do not lend themselves to measurement of various 
types of interpersonal skills (such as teamwork, leadership, and persuasiveness) or 
oral communication skills (such as speaking and listening skills). 

The Reliability and Validity with Which Attributes Can Be Measured 

Different categories of worker attributes also vary in the degree of precision 
or stability (reliability) and the degree of accuracy (validity) with which they can 
be measured. In general, aptitudes and abilities, basic workplace skills, and 
occupation-specific skills and knowledge can be measured with reasonably high 
degrees of reliability and validity when assessed using appropriate methods. In 
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general, personal qualities (personality traits, values, and attitudes) can be as- 
sessed with somewhat lower (but generally acceptable) levels of reliability, al- 
though validity can vary widely depending on the specific method of assessment 
used and the specific purpose of the assessment, (e.g., validity tends to be higher 
when such measures are used for purely diagnostic or developmental purposes 
than for personnel selection purposes). The measurement of many cross-func- 
tional skills (such as organizing, planning, fact finding, and information analy- 
sis), particularly the “softer” skills (that is, interpersonally oriented skills such as 
teamwork, negotiation, leadership, and persuasiveness) is presently problematic 
for a number of reasons detailed later in this paper. 



WORK 

The historic changes that have been occurring in the workplace over the past 
decade or so are discussed in great detail in numerous sources (e.g., APDOT, 
1993; Coates et al„ 1990; Johnston and Packer, 1987; Meridian Corporation, 
1991; Offerman and Gowing, 1993; Pearlman, 1995; Reich, 1991). These trends 
and changes can be summarized in terms of two major categories: changing de- 
mographics and changing organizations. 

Changing Demographics 

This refers to the changing characteristics of workers and can be character- 
ized in terms of the following key trends or issues: 

• The Changing Age Distribution of the Work Force. Significantly fewer 
young people will be entering the job market than in the recent past, leading to a 
shrinking pool of entry-level talent and greater competition among organizations 
for their services. 

• The Changing Gender, Ethnic , and Cultural Composition of the Work 
Force. This reflects slower U.S. population and work-force growth coupled with 
rapid world work-force growth, resulting in increasing work-force diversity, with 
more women, minorities, and immigrants composing the available labor force and 
white males composing only 15 percent of the projected net increase in the work 
force over the next 10 years. 

• Anticipated Skill Shortages in Critical Areas and Industries. This refers 
to the much-written-about skills gap, wherein the need for increasing types and 
levels of skills in a society of rapid technological advances and change will far 
outstrip the available types and levels of skills available in the applicant popula- 
tion (see also Holzer, Chapter 2, this volume). The problem will be exacerbated by 
the projection that typical American workers will face three to four career changes 
during their work lives. 

• Changing Lifestyles of Workers. This includes a dramatic increase in 
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single-parent households, increasing numbers of dual-income families, and a 
growing underclass of disadvantaged disaffected people. 

Changing Job Attitudes of Workers. These include an increased desire for 
autonomy, self-development, and balance between work and family life. 

Increasing Size of the Contingent” Work Force. This refers to temporary 
and part-time workers, contractors, consultants, “life-of-project” workers, and 
leased employees with less loyalty to a given organization. This will result in 
different types of working relationships (e.g., remote supervision, flexible work- 
ing arrangements, telecommuting) and will make it more difficult to maintain the 
shared vision and culture essential to a customer/service focus. 



Changing Organizations 

This refers to the changing characteristics of the broader economic context, 
the organizational context, and the immediate work and job context in which 
work is performed and can be characterized in terms of the following key trends or 
issues: 



* An Increasingly Global Economy. In this economy the viability and prof- 
itability of organizations will become increasingly dependent on their ability to 
penetrate and compete in foreign markets. This will necessitate not only greater 
understanding of foreign clients, markets, and suppliers but also the ability to 
manage increasingly diverse elements within one’s organization. In addition, 
global competition for labor resources (i.e., young, well-educated, mobile work- 
ers from other countries) will increase. 

• An Increasing Infusion of Technology. This infusion of technology (e.g., 
computer use, advanced telecommunications) will occur at all levels and in all 
types of work, resulting in changed ways of working and alteration of traditional 
concepts of work and time. 

The Continued Shift from a Manufacturing to a Service Economy. This 
will result in a continued decline in production-oriented jobs and a continued 
increase in service-oriented jobs. 

Increasing Value Placed on Intellectual Capital. Intellectual capital, the 
a gg re gute knowledge and skill base of the work force, will increasingly become a 
key competitive advantage for increasingly knowledge-intensive businesses and 
work enterprises. 

The Changing Size and Structure of Organizations . This is evidenced by 
many company failures and frequent downsizings among the survivors. In addi- 
tion, there will be much restructuring into flatter organizations with fewer layers 
of management and fewer people at upper levels; increasingly decentralized deci- 
sion making, greater reliance on purchased components and services; and in- 
creasing numbers of mergers, acquisitions, buyouts and various strategic net- 
works and alliances — which will result in highly dynamic and ever-shifting 
corporate cultures. 
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• The Increasing Use of Work Teams . This occurs as work tasks and activi- 
ties become more knowledge based, service oriented, interdependent, and demand- 
ing of decision making at the point of production as a result of increased pressure 
for performance brought about by both new technology and global competition. 

TWENTY-FIRST CENTURY WORK 

Changing demographic and organizational contexts of work will necessitate 
shifts in human resources planning and strategy, especially in the following areas. 

Retention of Skilled Employees 

Organizations will need to increasingly focus on retaining skilled employees 
to cope with anticipated skill and labor shortages. This implies increased impor- 
tance on attending to issues of worker satisfaction (i.e., worker interests and val- 
ues) and hence an increased focus on vocational and career guidance to promote 
the entry and migration of people into areas of work they will find satisfying and 
rewarding. 



Career Lattices 

The development of “career lattices” (worker development within and across 
occupational and organizational levels, rather than upward development) will 
become more important as organizations streamline and restructure, resulting in 
fewer promotional opportunities and more career plateauing. This will necessi- 
tate a broader and deeper understanding of job and occupational interrelation- 
ships, so that there are clear “road maps” of skill and knowledge requirements 
within and across occupational areas. 

Effective, Flexible Organizational Training and Retraining 

The need for effective and flexible organizational training and retraining 
strategies and methods will increase in importance as organizations seek to adapt 
to rapidly increasing technology demands and rapidly changing work environ- 
ments and organizational needs and as they seek to maximize returns on their 
investment in workers (particularly in view of likely escalating recruitment and 
selection costs). This further implies that organizations will need to place greater 
emphasis on the selection for or development of transferable skills, that is, skills 
that are likely to have applicability across different areas or families of work and 
jobs (e.g., the cross-functional skills and generalized work activities defined in 
the APDOT content model). 
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Selecting Employees Who Can Learn 

The identification and selection of individuals with both the capacity and the 
motivation to learn, to be trained (to maintain currency of skills and knowledge 
within their area of work or specialization), and to be retrained or “reskilled” (to 
acquire skills and knowledge related to new areas of work) will increase in 
importance as organizations attempt to build and retain their intellectual capital. 



Selecting for or Developing Cross-Functional Skills 

To the degree that work tasks and activities across different jobs and func- 
tions become increasingly interdependent, organizations will need to place 
greater emphasis on selection for or development of various skills related to 
effective team performance and the ability to operate within increasingly net- 
worked and decentralized structures (e.g., interpersonal and communication 
skills, negotiating skills, conflict management skills, and information gathering 
and analysis skills)— most of which are subsumed, in the APDOT content model 
terminology, by the category of cross-functional skills. 



Contextual Aspects of Performance 

Organizations will increasingly need to attend to the contextual aspects of 
performance (i.e., behaviors that facilitate the performance of others and of the 
organization as a whole) as a way to enhance the quality of work life in an organi- 
zation (related to the retention of skilled employees) and to maintain competi- 
tiveness and service quality in an increasingly less forgiving and results-oriented 
climate. This implies an increasing need for worker assessment, selection, and 
development for attributes— such as teamwork, leadership, and service orienta- 
tion — related to these aspects of performance. 



Toward a Conceptual Model of Work and Performance 

Figure 6-1 displays in schematic form a general model of work performance 
(originally presented in Pearlman, 1994b) that integrates the key elements con- 
sidered thus far here. The model provides a theoretical framework for understand- 
ing the components and the direct and indirect antecedents of work performance 
in the emerging twenty-first century workplace. It is based largely on, and repre- 
sents an attempt to synthesize, the recent job performance theory development 
work of Campbell et al. (1990, 1993), Schmidt and Hunter and their associates 
(Hunter, 1983, 1986; Schmidt and Hunter, 1992; Schmidt et al., 1986), and 
Borman and Motowidlo (1993). The labeling and description of much of the 
model and its terms are designed to be consistent with APDOT content model 
terminology, and the variables and relationships depicted are intended to be 
generally consistent with the conceptual structure and empirical evidence de- 
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FIGURE 6-1 General work-performance model. 



scribed by the authors cited above. The proposed model’s chief extensions of 
previous work lie in its integration of the role of the work environment, its empha- 
sis on contextual performance, and its greater elaboration of the role of different 
classes of worker attributes and skills-related information categories, a develop- 
ment facilitated by the APDOT content model. 

This general work performance model proposes the following definitions 
and relationships. 



Two Components of Performance 

There are two distinguishable aspects or components of performance: task 
performance and contextual performance. Task performance is the performance 
of formally prescribed and recognized tasks and activities required by a specific 
job. Contextual performance (see also Borman and Motowidlo, 1993) is the 
performance of activities that are not specific to a particular job and that support 
the organizational, social, and psychological environment in which task perfor- 
mance occurs. 
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Results 

Results (which refer to the effectiveness or evaluation of the outcomes of 
performance) are distinct from performance and are determined jointly by (1) a 
worker’s task and contextual performance and (2) certain characteristics of the 
work environment (see Campbell et ah, 1993). Final results can in part be subject 
to the influence of factors beyond a worker’s own performance or control. For 
example, good sales performance may not result in a high proportion of closed 
sales in a depressed market or territory and may not result in high profits if selling 
prices have been temporarily lowered as a strategy to increase market share. 



Two Components of Results 

There are two distinguishable aspects or components of results: outputs and 
value-added benefits. Outputs are related to the more formally recognized, objec- 
tively measured, and more or less concrete deliverables for which a worker is held 
accountable; outputs tend to have immediate, short-term consequences (e.g., the 
work outcomes defined in the APDOT content model, such as products produced, 
services rendered, sales and profits). Value-added benefits are related to less 
formally recognized, more subjectively measured, less concrete outcomes, and 
these tend to have more indirect and longer-term consequences (e.g., customer 
and employee satisfaction, enthusiasm, and loyalty). It is further hypothesized 
that the effectiveness of task performance is a direct determinant of outputs and an 
indirect determinant of value-added benefits, while contextual performance is 
a direct determinant of value-added benefits and an indirect determinant of 
outputs. 

The value of defining two components for both performance and results 
stems from mounting evidence that in each case the two components have some- 
what different antecedents (e.g., contextual performance is influenced more by 
personal qualities and task performance more by general cognitive abilities), are 
hence selected for and developed or improved in different ways, and have differ- 
ent kinds and amounts of value to an organization. In particular, there is growing 
evidence for the increasing strategic importance of contextual performance and 
value-added benefits owing to the various emerging demographic and workplace 
trends described above. As one example, the growing skills gap (the difference 
between the demand for and the supply of skilled workers) has substantially 
increased the strategic value of maintaining high job satisfaction among employ- 
ees as a way to retain highly skilled workers, something that has become an 
increasingly critical competitive advantage. This implies that human resources 
strategies and programs need to place increasing emphasis on the contextual 
aspects of job performance and the value-added benefits of results. Unitary defi- 
nitions of performance and results would mask these differences, whereas recog- 
nizing, identifying, and highlighting these distinctions enables an organization 
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to capitalize on them in various human resources strategies and programs, includ- 
ing the types of skill investment initiatives that are the backdrop of this paper. 

Determinants of Task Performance 

Task performance is determined jointly by an individual’s environment- 
congruent occupation-specific skills, occupation-specific knowledge, basic work- 
place skills, aptitudes and abilities, and (through its effect on performance as a 
whole) motivation to perform. Contextual performance is determined most di- 
rectly by an individual’s environment-congruent cross-functional skills and 
(through its effect on performance as a whole) motivation to perform, and per- 
sonal qualities and interests. “Environment-congruent” is used in this context as 
equivalent to “work- or job-related”; that is, it denotes whatever worker attributes 
are required by the work system or job design characteristics including specific 
job, role, or task demands — of the immediate work or job context. 

Determinants of Motivation 

An individual’s motivation to perform is determined jointly by certain charac- 
teristics of the work environment (e.g., recognition and reward systems, the 
presence of goals or performance standards) and certain environment-congruent 
personal qualities and interests (e.g., high-achievement orientation and entrepre- 
neurial interests for sales jobs). In formulating job performance theory, Campbell 
et al., (1993) defined motivation in a manner consistent with its conventional 
representation in the literature, that is, as involving the direction, amplitude, and 
duration of volitional behavior. Specifically, they define motivation as the com- 
bined effect of three choices-to expend effort, the level of effort expended, and 
persistence in the chosen level of effort expenditure. The present model goes 
slightly further in positing the general categories of such antecedents (work con- 
text, personal qualities, and interests), at which level the model remains consis- 
tent with most major theories of motivation, which generally differ primarily in 
terms of the specific variables or elements of focus within these broad categories. 



Skills and Knowledge 

Cross-functional skills, workplace basic skills, and occupation-specific skills 
and knowledge are attributes that are acquired as a function of an individual’s 
education, training, and experience, which are intended to represent the major 
categories of an individual’s formal opportunities to learn and practice. 



An Ability-Experience Path 

Both the opportunities for and the benefits or effectiveness of education, 
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training, and experience vary as a function of the individual’s aptitudes and 
abilities and possession of particular skill-related, knowledge-related, and learn- 
ing-/motivation-related personal characteristics and interests. This postulate is a 
slight departure from the model hypothesized by Schmidt et al. (1986), which did 
not incorporate a path from ability to experience. The inclusion here of an abil- 
ity-experience path or relationship is based in part on the rationale suggested by 
Borman et al. (1993) that an individual’s abilities are likely to be recognized by 
the organization and used in part as a basis for assigning work and responsibili- 
ties, thus providing opportunities for experience. 

The relationship between personal qualities/interests and experience is based 
in part on a similar rationale, namely, that an individual’s opportunities for expe- 
rience are partly created by the recognition by influential others of his or her job- 
related personal qualities (i.e., in addition to ability), such as integrity, trustwor- 
thiness, and conscientiousness. This view is supported by a survey (Michigan 
Department of Education, 1989) that found these and related qualities to com- 
pose seven of the top eight attributes (out of 86) ranked by over 3,000 employers 
for importance to entry-level employment. This relationship is also based on the 
hypothesis, consistent with the investment theory of ability (Catell, 1987), that 
people’s skill-, knowledge-related, and learning/motivation-related personal 
characteristics and interests determine in what types of development (i.e., toward 
what types of specific skills or jobs) they choose to invest these attributes. For 
example, a person with altruistic needs or values and an interest in working closely 
with others is more likely to seek education, training, or experience in social work 
than in sales. 

These relationships and hypotheses provide the rationale for one of the cen- 
tral theses of this paper, namely, the importance of cross-functional skills to effec- 
tive contextual performance. From one point of view, this may be seen as discrep- 
ant with Borman and Motowidlo’s (1993) discussion of contextual performance, 
which focuses on its likely antecedents in the domain of personal qualities. How- 
ever, from the perspective of the present model of work performance, this thesis 
can rather be as an elaboration of their position, wherein many cross-functional 
skills (primarily those within the noncognitive domain) are viewed as, in effect, 
representing a more proximal (i.e., to performance) manifestation of such personal 
qualities. From this point of view, such cross-functional skills are the more imme- 
diate precursors to effective contextual performance — the outcome of the shap- 
ing or “investment” of various personal characteristics over time into work-re- 
lated form. 

In other words, this suggests a relationship between personal qualities and 
(contextual) performance within the noncognitive domain that is analogous to 
that found by Hunter (1983, 1986) within the cognitive domain, where the strong 
and well-established empirical relationship between general cognitive ability 
and task performance was shown to be largely indirect — a function of individu- 
als’ investment of their cognitive ability into the acquisition of occupation-spe- 
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cific knowledge, which is the stronger and more immediate antecedent of effec- 
tive task performance. Thus, for example, the importance of many of the personal 
characteristics either found or hypothesized to be related to contextual perfor- 
mance (e.g., conscientiousness, extroversion, openness to experience, altruism, 
integrity, need for achievement, etc.) may in fact also turn out to be largely indi- 
rect — a function of the more immediate antecedents of effective contextual per- 
formance found in the corresponding cross-functional skills (e.g., teamwork, com- 
munication, customer service, negotiation, leadership, conflict management) into 
which these traits have been invested and shaped through training, education, 
and experience. 

Quality of Worker Performance 

Although not depicted graphically in Figure 6-1, the model also posits that 
the quality or level of worker performance (as distinct from the content of such 
performance as task or contextual performance) is a function of (1) the degree of 
congruence or match between the specific characteristics and demands (e.g., skill/ 
knowledge, role, results requirements) of the work environment and an 
individual’s occupation-specific skills and knowledge, cross-functional skills, 
basic workplace skills, and personal qualities and interests (in other words the 
match between work requirements and worker attributes) and (2) the individual’s 
degree of competency, proficiency, or possession of those required (i.e., environ- 
ment-congruent) worker attributes. Said another way, this means that a worker’s - 
performance level is a function of his or her degree of possession of or proficiency 
in the attributes required by the work. 

MAPPING SKILLS TO WORK 

What percentage of U.S. workers need to know how to prepare a budget? Or 
need to know principles of electricity? What percentage of U.S. workers need to 
be able to do arithmetic computation to perform their jobs effectively? Or need 
good eye-hand coordination? Or need to be able to make effective oral presenta- 
tions to groups? The answer to all these questions is unknown. Figure 6-2 shows 
how such data, if they existed, might be arrayed; it provides a sense of how useful 
such information might be, for example, in prioritizing different types of skills 
and knowledge as targets of national education- and training-oriented initiatives. 
An ideal analysis would require clear, precise operational definitions for skills 
and types of knowledge; would collect data at broad (e.g., aptitudes and abilities) 
and narrow (tasks, duties, and generalized work activities) levels of analysis; and 
would have available a host of associated contextual information (industry and 
organization type, job and work design information, etc.). 

The closest approximation to such a national system is, or used to be, the 
Dictionary of Occupational Titles and various associated materials (U.S. Depart- 
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FIGURE 6-2 Skill requirements of U.S. jobs: Percentage of positions for which various 
skills and knowledge are required for effective job performance (hypothetical data). 



ment of Labor, 1977, 1979a, 1979b, 1979c, 1981, 1991). Funding for them was 
radically reduced in the early 1980s, and since then these materials have not been 
updated to the degree necessary to ensure that the job information is current and 
fully reflects today’s occupational spectrum. At present, we therefore have very 
little aggregate knowledge of the true underlying structure of job-related skills 
and knowledge across the occupational spectrum in the United States. 

There is a great deal of empirical work of this type available for individual 
jobs and occupational areas, and there have been some noteworthy theoretical 
developments regarding the structure of work tasks (and, by implication, associ- 
ated skills) within both industrial and cognitive psychology. However, neither 
discipline has an integrated body of empirically based outcomes in the form of a 
true skills (or knowledge) taxonomy applicable across the occupational spectrum 
(Pearlman, 1980). (Gottfredson’s work in this area, 1981, 1983, 1986a, repre- 
sented noteworthy steps in this general direction but was limited by the quality of 
the underlying Dictionary of Occupational Titles data available to her.) As a 
result, recent and current skill development initiatives, such as SCANS, Goals 
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2000, and School-to-Work, can be likened to attempts to lay down a complex 
road system — in the present context a network of paths that lead from unskilled to 
job ready for a range of work areas or occupations — before a survey of the land has 
been completed. 

To be sure, the past few years have seen a significant number of studies, 
surveys, and reports that have attempted to address employers’ concerns about 
the skills and qualifications of students entering the work force after high school 
or college (Bailey, 1990; Cappelli, 1992; Carnevale et al., 1988; Grubb et al., 
1992; Michigan Department of Education, 1989; National Center on Education 
and the Economy, 1990; SCANS, 1991, 1992; Olsten Forum on Human Resource 
Issues and Trends, 1994; Van Horn, 1995). These studies have attempted to 
identify the worker skills, knowledge, and abilities most in demand in today’s 
and tomorrow’s workplaces. While the attributes identified in these studies have 
not been identical, most include in one form or another the following: reading/ 
writing; applied mathematics; interpersonal skills (e.g., teamwork, leadership, 
customer service, negotiation); oral communication; information gathering and 
analysis; problem solving; critical/creative thinking; organizing, planning, and 
decision making; various technical or functional skills specific to an occupa- 
tional area; and personal attributes (motivation, integrity, dependability, self- 
management). 

It is interesting to note that, although this list spans several skills-related 
information categories of the APDOT content model (basic workplace skills for 
the first two items, cross-functional skills for the next six items, occupation- 
specific skills and knowledge for the next-to-last item, and personal qualities for 
the last item), the large majority of items represent cross-functional skills. It is 
also interesting to note that, despite widespread concern in recent years about the 
emerging twenty-first century workplace requiring “new” skills with which entry- 
level workers are not well equipped, little on the above list could qualify as new 
or different; rather, they are skills that have long been recognized as important for 
many, if not most, areas of work. What might be new is that many of the skills had 
formerly characterized higher-level occupations; now they are becoming increas- 
ingly relevant to a wider range of jobs, owing to the types of workplace changes 
described earlier (e.g., increasing team design of work, the trend toward flatter 
organizations, and the trend toward driving decision-making authority down to 
increasingly lower occupational levels). In other words, the issue is not new skills 
so much as changes in the relative prioritization or importance of existing skills 
across the occupational spectrum. 

Despite the apparent usefulness of such study results, the information value 
of such studies and reports is significantly limited in terms of its utility for driving 
changes and reforms in education, training, and assessment. Most work of this 
type has not been grounded in a theoretically driven framework or based on 
methodologically rigorous procedures of work analysis. Rather, it has typically 
relied on surveys, focus groups, and inductive and qualitative data as the primary 
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means for gathering this information and drawing conclusions about the impor- 
tance of various types of skills. In some cases, attributes were not operationally 
defined or quantitatively linked to underlying information on work content. As 
a result, and as will be illustrated below, the skills derived from such work are in 
most cases insufficiently specified to be of optimal value for their intended pur- 
poses, such as the specification of education and training needs, assessment de- 
sign, and standards setting. 

In principle, the design of an optimal approach to such work is relatively 
straightforward. In broad terms (and assuming the use of professionally con- 
ducted and technically sound methods and procedures throughout), the major 
steps would consist of the following: 

1. The systematic collection of work- or job-oriented information (such as 
tasks, duties, performance standards, and products and services, as defined in the 
APDOT content model) across a sample of occupations that was developed to be 
maximally representative of the current or emerging distribution of occupations 
throughout the economy. Ideally, such a sampling plan would be based on infor- 
mation that would permit additional stratification of the sample (in terms of the 
organizations sampled) based on important work-context variables, such as the 
degree of complexity of the work, the degree of task interdependence or team 
organization of work, and the use of technology. These data would be collected 
through a customized, structured job analysis questionnaire completed by a suf- 
ficiently large sample of appropriate local job experts (such as job incumbents or 
supervisors) representing multiple organizations for each occupation sampled. 

2. Development of an optimal representation of the work content structure 
across the economy (i.e., an empirically derived job classification structure) 
through the use of quantitative cluster analysis procedures on the data collected 
in step 1. 

3. On the basis of the results of step 2, derivation of worker-oriented informa- 
tion in terms of the various categories of skill related information and other worker 
attributes defined in the APDOT content model. This information would be 
derived for each occupation (or occupational area) developed in step 2. This 
would be accomplished by teams of trained analysts using anchored 
attribute-rating scales. This step assumes prior development of provisional tax- 
onomies of the various skill-related information categories and development of 
improved and updated rating scales of worker attribute requirements. 

4. Development of occupational/skill clusters at different levels of analysis 
(reflecting the various skill-related information categories of the APDOT content 
model) through the use of quantitative cluster analysis procedures on the analyst 
ratings completed in step 3. 

Step 4 would produce a variety of clustering solutions, each providing a road 
map of transferable skills (i.e., skills important for multiple occupations or occu- 
pational areas) at a different level of analysis. The appropriate interpretation and 
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use of such information for various purposes (e.g., identification of career lat- 
tices, prioritization of skills for standards setting or the development of educa- 
tion/training curriculum, and allocation of skills to different tiers of an integrated 
education/training strategy) will inevitably involve intensive analysis and dis- 
cussion among appropriate experts and stakeholders in these various sectors of 
activity. 

It can be observed that this suggested approach is essentially identical to the 
process that is now under way to implement the APDOT content model via devel- 
opment of a working prototype on a representative sample of about 20 percent of 
the occupational spectrum and the ultimate development of a new, automated 
Dictionary of Occupational Titles , to be known as 0*NET (for Occupational 
Information Network) (American Institutes for Research, 1995). The results of the 
prototype development project, possibly in conjunction with American College 
Testing’s current National Job Analysis Study (American College Testing, 1 994), 
could serve as the basis for development of appropriate sets of required rating 
scales for the worker attributes needed for step 3. 

Such an approach provides for the collection and analysis of a rich and broad 
array of occupational information that would be useful for multiple purposes. It 
would significantly advance our research and knowledge base regarding the un- 
derlying structure of job-related skills and knowledge, thus enabling the devel- 
opment of relatively sophisticated and multifaceted strategies and programs that 
could truly advance the objectives of the various federal initiatives described at 
the beginning of this paper in a scientifically and technically sound manner. 
Despite the cost and time such an approach entails, it is hard to overestimate the 
long-term value to the nation of a skill and occupational information source of 
this quality. 

Table 6- 1 presents a simplified hypothetical example of the results of such an 
approach to the mapping of skills to work. This table displays elements of four of 
the APDOT content model’s skills-related information categories — aptitudes and 
abilities, cross-functional skills, occupation-specific knowledge, and the occupa- 
tion-specific skills associated with one of the cross-functional skills (information 
gathering). The table shows which of these elements are significantly related to 
each of two jobs in two different industries. (The data are assumed to be derived 
through appropriate work and job analysis techniques.) 

This table exemplifies how the degree of generality or specificity with which 
skills are defined affects the similarities and differences that can be observed 
among jobs. For example, if we were to look at the skill profile of each of the four 
jobs only in terms of the most general category of skills (aptitudes and abilities), 
we would conclude that all four jobs were essentially identical. However, if we 
were to include cross-functional skills in the profile of each job, we would begin 
to observe increasing differentiation among jobs; this differentiation would in- 
crease even further if we were to take into account occupation-specific skills and 
knowledge in making such comparisons. This illustrates how the degree of gen- 
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TABLE 6- 1 Hypothetical Example of Occupational/Skill Clustering Scenario 



Skill 

Category 


Architecture/Engineering 


Retail 




Drafter 


Administrative 

Clerk 


Buyer 


Administrative 

Clerk 


Aptitudes/abi li ties 










Verbal 


X 


X 


X 


X 


Quantitative 


X 


X 


X 


X 


Spatial 


X 








Cross-functional skills 










Organizing/planning 


X 


X 


X 


X 


Information gathering* 7 




X{A1, A2, A3. A4) 


X(AI, Bl. B2. B3) 


X(AI. A2.C1.C2) 


Negotiation 






X 




Occupation-specific 










knowledge 










Pricing strategies 






X 




Computer-aided 


X 








design software 










Word processing 




X 




X 


software 











NOTE: An X in a cell indicates that the skill is significantly related to the job. 
f, Codes for required occupation-specific information-gathering skills are shown in parentheses; code 
definitions are as follows: A1 = ability to retrieve records of invoices paid; A2 = ability to verify 
previous employment of job applicants by telephoning listed references; A3 = ability to identify, 
locate, and acquire publications on recent technical developments in areas of interest to professional 
staff; A4 = ability to research price information on CAD software; B1 = ability to search on-line 
computer databases for market information on customer buying patterns; B2 = ability to review 
merchandise catalogs, specifications, and price sheets to determine merchandise of highest value; 
B3 = ability to interview alternative suppliers to determine availability, ordering and billing proce- 
dures, and delivery schedules for merchandise; Cl = ability to obtain daily attendance figures from 
office supervisor; C2 = ability to interview customers by telephone to obtain information on 
satisfaction with purchases. 



erality or specificity of skill definition and analysis limits the potential degree of 
differentiation that can be made between jobs. It also shows how the breadth or 
narrowness with which skills are defined ultimately (i.e., after data collection) 
affects which skills are found to be relatively specific and which are more broadly 
applicable (i.e., transferable) and to what degrees. This in turn defines the content 
domain or breadth of applicability of such things as associated assessments, 
associated training, and associated skill standards and of the portability of 
certification. 

Table 6-1 also helps us to understand the concept of transferable skills. 
Transferable skills can be defined as skills that have applicability (i.e., are impor- 
tant determinants of effective performance) across various ranges of occupations 
or occupational clusters. The identification of transferable skills is closely re- 
lated to the development of career lattices, which are extremely important for 
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issues of worker training and retraining. Career lattices are groupings of jobs 
within relatively homogeneous occupational levels (i.e., levels of complexity, 
difficulty, responsibility) that usually have some substantial subset of skills in 
common, so that individuals who possess most or all of the skills required for 
effective performance in one of the jobs in the lattice are likely to be able to 
effectively perform other jobs in the lattice with relatively modest amounts of 
additional training, education, or experience. 

From this viewpoint it can be seen that occupational clusters created to 
maximize skill transferability will essentially result in the delineation of different 
types of career lattices. The degree to which particular skills are common to, and 
hence transferable across, a given range or set of occupations is established via 
the process of job analysis and subsequent clustering. It is through careful work 
and job analysis that the skills required of different jobs are identified, and through 
the clustering process (i.e., the specific method and grouping criteria used) that 
the degree of skill transferability is set. This implies that while the true underly- 
ing structure or “map” of skills across the occupational spectrum is something 
akin to a “state of nature” that is “discovered” through research and analysis, the 
manner in which the resulting information is used or harnessed is largely under 
the control of the analyst or researcher. Thus, occupational clusters can be 
created to reflect varying degrees (or tolerance levels) of within — cluster skill 
transferability. 

Because cross-functional skills constitute the “middle ground” or intermedi- 
ate level of the skill continuum from generality to specificity, they potentially 
represent the key to meaningful skill transferability across occupations and in- 
dustries and hence are of high interest for the various federal initiatives described 
earlier and for school-to-work programs in particular. 

However, even the relatively simple illustration of Table 6-1 reveals the 
underlying complexity involved in understanding and defining the transferabil- 
ity of cross-functional skills. This can be seen by considering information gath- 
ering, which is a good example of what is commonly viewed as a transferable skill 
of the type envisioned in the SCANS work and the Goals 2000 legislation. It is a 
likely target for the development, assessment, and certification of skill standards 
because of its broad practical utility in both educational and work settings and its 
typical neglect as an explicit part of K-l 2 education. It is also a skill that has been 
frequently identified as important to emerging high-performance workplaces in a 
number of recent employer surveys, as noted above. 

When considered in light of the actual content and context of just the three 
jobs represented in Table 6-1, the seemingly simply defined and easily under- 
stood cross-functional skill of information gathering can be seen to represent 
widely varying types of both tast content and task complexity, and to subsume 
such varying processes as the following: simple retrieval of readily available 
information (as exemplified by occupation-specific skills A1 and Cl); simple 
interviewing or questioning of individual sources based on structured guidelines 
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for the content and sequencing of questions (skills A2 and C2); moderately 
complex interviewing or questioning of multiple sources on multiple related 
subjects requiring some improvisation of questions based on previous responses 
(skill B3); relatively simple price comparison research (skill A4); moderately 
complex price comparison and related research from written sources (skill B2); 
moderately complex questioning and scanning of multiple oral and written infor- 
mation sources (skill A3); and gathering of relatively complex quantitative data 
from multiple information sources requiring computer skills, database knowl- 
edge, and financial and market knowledge (skill Bl). 

This analysis illustrates the importance of underlying work content and sur- 
rounding work context for a full understanding of the meaning of any cross- 
functional skill; without this understanding it is not possible to target education, 
training, assessment, and related initiatives, such as the development of skill 
standards and skill certification programs. It also illustrates the limitations of 
simple surveys or focus group studies of employer-desired skills. Inevitably, the 
skills derived from such studies are insufficiently specified to be of optimal value 
for their intended purposes. This is because the skills receive unitary labels and 
definitions that do not reflect likely differences in work content (e.g., tasks, ac- 
tivities, outputs) or work context (e.g., complexity of functioning) across occupa- 
tional areas of settings in which the skill is required. For example, the mere 
identification of, say, problem-solving, as and important employability skill, is of 
almost no value as a guide to the design of education curricula, training programs* 
or assessment tools regarding this skill— that is, without further elaboration of the 
work content and work context factors associated with a given application of the 
skill, without which it lacks essential definition. 

While the need to account for differences in underlying work content in 
cross-functional skills may seem readily apparent, the effects of work context are 
perhaps less obvious and considerably less tractable. Despite its increasing im- 
portance to the meaning and understanding of twenty-first century work and work 
performance, work context is the least well developed and understood of any of 
the three major domains of work-related information (i.e., person-, work-, and 
context-oriented variables). While there have been some noteworthy attempts to 
systematize information on work context (e.g., Naughton and Outcalt, 1988; 
Wetrogan et al., 1983), none has really attempted to simultaneously and system- 
atically tackle all levels and all facets of this domain. The previously mentioned 
work in progress on 0*NET (American Institutes for Research, 1995), which is 
designed to operationalize the APDOT content model, could be the basis for 
significant advances in this area. 

This is an area in need of much more research, with the goals of developing a 
comprehensive taxonomy of work context variables and ultimately, based on 
this, of general categories of work settings or situations (see Burke and Pearlman, 
1988). Research of this type would tell us, for example, how many varieties of 
oral communication skill (or teamwork skill, or information-gathering skill, or 
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decision-making skill) it is important to differentiate and define so as to reason- 
ably represent the range of applications (content and context) of this skill across 
the U.S. occupational spectrum. It would reveal the degree to which such distinc- 
tions are driven more by, for example, industry segment (e.g., manufacturing vs. 
service), job complexity (e.g., in terms of information-processing demands), or 
task interdependence (e.g., working alone vs. working in teams) or some combi- 
nation of these (or other work context variables). Without such a foundation we 
have little basis for developing national education, training, and assessment strat- 
egies directed toward the types of cross-functional skills that represent the keys to 
both organizational success in the twenty-first century workplace and employ- 
ment security for the twenty-first century worker. 



THE DILEMMA OF CROSS-FUNCTIONAL SKILL DEVELOPMENT 

There are many unresolved training-related issues concerning cross- 
functional skills. The issues are complicated by the fact that such skills are linked 
both to aptitudes and abilities and personal qualities and interests (which set 
limits on their trainability, as discussed under “Trainability of Attributes” above) 
and to specialized skills and knowledge (which are often present or required in 
the application of a given cross-functional skill in a specific setting). For ex- 
ample, the degree to which an individual can be successfully trained in “negotiat- 
ing skill” is in part limited by his or her underlying verbal ability. Moreover, 
although a meaningful generic definition of negotiating skill can be developed 
(e.g., “the ability to reach formal or informal agreements with, obtain commit- 
ments from, or arrange plans with other individuals or groups in a way that serves 
or promotes mutual goals or interests”), the effective application of negotiating 
skill within a particular job context will almost always entail mastery of a certain 
body of specialized knowledge that is different from job to job. This will in effect 
result in different operational definitions of negotiating skill for different jobs (or 
job families). Thus, for example, the meaning (as well as the complexity) of 
negotiation skill is substantially different for, say, an automobile salesperson and 
a labor contract negotiator. 

The resulting dilemma from an education or training perspective is that, if 
such cross-functional skills are trained at the generic level, such training is not 
likely to be immediately transferable to a specific job or work setting (i.e., with- 
out the acquisition of the associated context- or occupation-specific knowledge). 
On the other hand, if such skills are trained in the context of a particular work 
setting (i.e., if the specific skills and knowledge associated with the use of a given 
cross-functional skill for a particular job are incorporated), such training is not 
likely to be immediately transferable to different jobs or settings, even those that 
require the “same” (generically defined) skill. Even newer and evolving training 
techniques (such as metacognitive skills training) that attempt to improve ge- 
neric skills through contextual training of cognitive resource management and 
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self-monitoring skills have failed to produce evidence that the skills learned 
through such methods transfer beyond the specific subject matter and informa- 
tion medium involved in the training (Gitomer, 1992). 

Resolution of this dilemma may lie in an integrated education and training 
strategy wherein the generic components (or building blocks) of such skills are 
consciously built into primary- and secondary-school curriculum content and 
(perhaps more importantly) into modes of teaching and learning while the more 
specialized components are reserved for postsecondary education and 
employment-related training. This is clearly the direction of the contemporary 
educational reform movement in this country (SCANS, 1992), which argues for 
teaching in context, experience-based and application-oriented learning, inte- 
grated curricula, and so forth. This approach is also very similar in concept to, 
and hence highly compatible with, the three-tiered system of skill standards sug- 
gested by Tucker (1993), which essentially proposes an increasingly job-specific 
focus on skill development as one moves through primary and secondary educa- 
tion, to various forms of postsecondary education or training, and on to employer- 
specific or on-the-job training. 

Moreover, such an approach could resolve a schism in the implicit model of 
education and training in this country. Under this model the development of 
aptitudes, abilities, and basic workplace skills has traditionally been the province 
of primary and secondary educational institutions, whereas the development of 
specialized skills and knowledge has primarily been the province of either spe- 
cialized secondary-school institutions (such as vocational and technical schools), 
postsecondary educational institutions (colleges and universities), and employ- 
ment settings themselves (i.e., through on- or off-the-job training). The interme- 
diate category of cross-functional skills (such as organizing and planning, deci- 
sion making, and especially such interpersonally oriented skills as teamwork, 
negotiation, speaking and listening, and coaching or mentoring others) has, un- 
fortunately, largely been ignored as a specific target of systematic development 
efforts under this model. 

The ultimate effectiveness of such an approach, however, depends on our 
ability to close or reduce two key knowledge gaps. The first, described earlier, 
concerns the absence of a structure or taxonomy of job-related skills and knowl- 
edge across the occupational spectrum that takes into account, or is built on, a 
taxonomic infrastructure of both work content and context. The second concerns 
our limited understanding of the malleability or trainability of the different cat- 
egories of skills-related information discussed throughout this paper. Although 
the available research has allowed for deduction of some general principles in this 
regard (as noted under “Trainability of Attributes” in the earlier discussion of the 
training utility model) we lack the depth of understanding and overarching 
theory in this area that could support the develbpment of much more focused and 
detailed skill development strategies than is presently possible. In the absence of 
a well-researched and “validated” taxonomy of work-related skills and knowl- 
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edge that explicates both the hierarchical and lateral interrelationships among 
such elements while also shedding light on underlying characteristics related to 
trainability, our ability to design education, training, and assessment systems that 
optimize the content, sequence, and method of teaching and learning cross-func- 
tional skills will be limited, as will be the effectiveness of such systems. Only 
when armed with such systematic knowledge of this content and contextual skills 
infrastructure will we be able to meaningfully define the skills we wish to develop 
and appropriately “allocate” different categories and specific elements of these 
skills to different tiers of such a learning and assessment system so as to optimize 
individuals’ skill and knowledge acquisition, retention, and transferability. 

CHALLENGES FOR ASSESSMENT 

The previously cited report of an employer survey conducted for the New 
Jersey Business-Higher Education Forum (Van Horn, 1995:15-17) states that: 

researchers are working to develop assessments of how well students learn [the] 
generic and specific skills and abilities sought by employers. . . . Thus far, no 
widely accepted tests have been developed. There are also disagreements about 
whether assessing and reporting on student skill acquisition is desirable. . . . The 
task of creating broadly accepted assessment tests is truly daunting. As one scholar 
observed, “ . . . these questions go well beyond any experiences educators in the 
United States have had in the arena of assessment and public policy.” [While] 
consensus exists on the importance of certain basic and advanced skills . . . 
there is little knowledge or accepted measuring techniques for determining how 
well college graduates master those skills in communication and critical think- 
ing [emphasis added]. 

This quotation captures the fundamental challenges we currently face re- 
garding the assessment of skills for the emerging twenty-first century workplace. 
As the quotation implies, these challenges can be viewed on two levels — one 
involving the development of tests or other assessment instruments needed to 
measure important skills, and the other concerning the manner in which the re- 
sults of such instruments are used in broader systems or programs. The major 
challenge at the former level, as implied by much of the discussion here, is the 
development of technically sound and practically useful measures of cross-func- 
tional skills. The major challenge at the other level is the need for a more focused 
and systematic integration of three conventional roles of assessment: its diagnos- 
tic function (i.e., to enable inferences regarding what has and has not been 
learned); its predictive function (i.e., to enable inferences regarding future perfor- 
mance or behavior); and its evaluative and incentive function (i.e., to enable 
inferences regarding level, status, or progress of either individuals or institutions 
and thereby influence the degree and direction of both individual and institu- 
tional investment in skill, knowledge, and ability development). Obviously, 
these two levels of analysis are not independent. The nature and properties of 
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assessment instruments set limits on their appropriateness and utility for different 
purposes, and the purposes of the assessment systems influence the design of 
instruments. 



Measuring Cross-Functional Skills 

Within the employment domain, cross-functional skills have most commonly 
been measured in assessment centers (Thornton and Byham, 1 982). These centers 
use structured, standardized role plays in which participants engage in various 
group and individual activities that sample important domains of work behavior 
and worker functioning (e.g., communication, organizing/planning, decision 
making, negotiating, teamwork) while a team of trained assessors observes them. 
Cross-functional skills have also been measured through work or job simulations, 
structured behavioral interviews (Motowidlo et al., 1992), patterned behavioral 
description interviews (Janz, 1989), situational interviews (Latham et al., 1980), 
records of behavioral consistency or accomplishment (Schmidt et al., 1979; 
Hough, 1984), and low-fidelity simulations (Motowidlo et al., 1990), which are 
essentially multiple-choice situational judgment tests. 

Within the education domain, cross-functional skills have been measured 
through what have been variously termed performance-based, alternative, or au- 
thentic assessments (Baker et al., 1993). The cross-functional skills typically 
assessed by such measures include decision making, organizing and planning, 
information gathering, oral communication, problem solving, and various types 
of interpersonal skills, such as leadership, teamwork, social sensitivity, behav- 
ioral flexibility, and negotiating skill. While the predictive validity of overall 
performance on such measures in the employment context has been fairly well 
established, less evidence is available regarding the predictive validity of their 
component dimensions (i.e., particular cross-functional skills). What does exist 
(see Table 5. 1 2 in Thornton and Byham, 1982, for a summary of assessment center 
dimension validity) is generally favorable but is based on a relatively small num- 
ber of studies. There are as yet few empirical reliability and validity data regard- 
ing the various forms of performance-based assessments in the educational con- 
text (Baker et al., 1993). 

Despite useful levels of predictive validity, there is virtually no evidence bear- 
ing on the construct validity of the component dimensions of any of the approaches 
mentioned above other than assessment centers. That is, there is no evidence that 
the procedures are actually measuring the intended skills. (The Motowidlo et al., 
1992, study is somewhat of an exception since it at least addresses the issue and 
presents some data relevant to convergent and discriminant validity of individual 
dimensions; however, the evidence they provide is not particularly compelling 
because of the similarity of the various processes used to differentially evaluate the 
dimensions.) For assessment centers, there is in fact a body of research bearing on 
the question of their dimensionality or construct validity in terms of both dimen- 
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sion-versus-exercise effects on overall performance (see Neidig and Neidig, 1984; 
Sackett and Dreher, 1982, 1984) and the underlying factor structure of dimensions 
(Russell, 1987). Such research has led to a conclusion of relatively weak construct 
validity for individual assessment dimensions and the likelihood that performance 
on the relatively large number of dimensions or cross-functional skills (generally 
10 to 20) assessed in a typical program can be accounted for by just a few underly- 
ing factors. This is likely due in part to the difficulty and complexity of raters’ 
making more refined judgments but also reflects the fact that there have been few 
attempts to build measures of individual cross- functional skills; that is, the tradi- 
tionally used procedures have generally attempted to simultaneously assess a vari- 
ety of such skills, thus exacerbating an already difficult information-processing 
task (Gaugler and Thornton, 1989). 

In addition, and related to this last point, the content validity of nonsimu- 
lation-based measures of cross-functional skills is often suspect. Motowidlo et al. 
(1990) somewhat euphemistically referred to their situational judgment test of 
various cross-functional skills as a low-fidelity simulation, in that the stimulus 
materials were written (rather than “performed”) representations of authentic situ- 
ations derived from the skill content domain of interest, and the required exam- 
inee responses (answering test questions about how one would respond to the 
given problem or situation) did not represent actual performance of the skill. 
Similar tools are being pilot tested in educational research (O’Neill et al., 1992) 
and nonprofit (American College Testing, 1991) domains, and an increasing num- 
ber of such instruments are being marketed commercially. Many purport to mea- 
sure such cross-functional skills as teamwork, customer service, and decision 
making. Sometimes these are administered in video form (wherein a scene pre- 
senting, say, a customer service problem is acted out), sometimes in oral form (as 
in situational interviews), and sometimes in written form (as in situational judg- 
ment tests). In each case, examinees must indicate what they would do or how 
they would handle the situation, by selecting from among multiple given alterna- 
tives, responding orally, writing a brief answer, or writing a longer response or 
essay. Despite the labels ascribed to these measures and the claims of some of 
their developers, there is, to my knowledge, not a shred of evidence that any such 
measures tap the target skill content domains to any significant degree. Particu- 
larly for interpersonally or performance-oriented skills (teamwork, leadership, 
customer service, communication, etc.), responding cognitively (as in multiple- 
choice situational judgment tests), orally (as in situational interviews), or in writ- 
ing (as in free-response or essay situational tests) to hypothetical situations or 
scenarios, however realistic and skill appropriate they may be, is not the same as 
“performance.” The often legitimate, empirically based claims of predictive va- 
lidity for such instruments should not be confused with attributions of content (or 
construct) validity, conclusions about which are not appropriate until such time 
as relationships between responses to such instruments and “true” performance 
on the target skills may be established through the appropriate research. 
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The above discussion suggests that, while some of the available measures of 
cross-functional skills are likely to have utility in systems designed to predict 
future performance, their diagnostic value — and hence their value for national 
skill development initiatives— is limited by the lack of both construct-related 
and content-related evidence. While “developmental” assessment centers (which 
are used only to provide developmental feedback to participants but not as a basis 
for making personnel decisions) have been commonplace in industry for many 
years, they universally have been almost based on, or designed in terms of, the 
work content and work context structure of particular occupational areas (e.g., 
first-line supervisors) or occupational levels (e.g., midlevel managers). They can 
thus have high developmental value to participants in those occupational areas 
or contexts but do not lend themselves to programmatic use across the occupa- 
tional spectrum, nor is there any straightforward way to equate similarly targeted 
assessment center programs because of the absence of any “marker variables” for 
cross-functional skills in the sense that these exist, for example, within the realm 
of cognitive ability measurement. 



Cross-Functional Skills and Evaluation Systems 

The evaluation function of cross-functional skill assessment is a critical com- 
ponent of several of the federal skills-related initiatives described earlier (SCANS 
and Goals 2000). The establishment of skill standards (i.e., proficiency levels) 
and the development of skill certification (indicating specified degrees of mas- 
tery) for cross-functional skills are central to both of these initiatives and are 
viewed by many as key to reforming school curricula and raising educational 
standards, strengthening the link between schools and workplaces, and increas- 
ing the likelihood that all American young people will have the opportunity to 
acquire the skills and knowledge necessary to effectively participate in the 
nation’s economy (SCANS, 1992). However, as I have discussed elsewhere 
(Pearlman, 1993, 1994a), this is easier said than done, as cross-functional skills 
pose special challenges for such applications. 

The basic concept of a skill standard implies a translation or an association 
between a given skill level of a person and a given performance level on a job. 
This implies the need for a number of things, such as the following: ( 1 ) definition 
of the target performance (task or task cluster) to which a skill standard will be 
addressed (with special consideration given to the narrowness or broadness with 
which such performance is defined), (2) determination of the worker attributes 
related to performance of the defined task or task cluster, (3) reliable and valid 
means of measuring performance on the defined task or cluster, (4) reliable and 
valid means of measuring the performance-related attributes, (5) specification of 
various levels of performance against which the performance-related attributes 
will be benchmarked, and (6) specification of the levels of performance-related 
attributes associated with these performance levels. 
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When such standards are used for certification purposes, an additional (and 
very high-stakes) step is required, namely, to establish which level of perfor- 
mance will be required for certification (or qualification, mastery, or whatever 
delineations are to be used) — in other words, to decide “where to make the cut.” 
Failure to carefully and appropriately set such skill certification levels creates the 
risk of either of two types of errors, which decision theorists call “false positives” 
and “false negatives,” each having different — but inevitably dysfunctional — 
consequences for both individuals and organizations. False positives refer to 
situations in which standards are set too low, resulting in incompetent or insuffi- 
ciently skilled people being considered qualified, or certified, and consequently 
assigned to jobs, training, or other activities for which they are not equipped. 
This is obviously harmful to the* receiving organization but can also result in 
possible psychological and even physical damage to individuals so misclassified. 
More insidiously, the proliferation of such effects over time will inevitably lower 
both the perceived and the actual market value of the certification or qualifica- 
tion standard, producing a de facto system of credentialism rather than a truly 
competence-based system. 

False negatives refer to situations in which standards are set too high, result- 
ing in competent or highly skilled people being disqualified or not certified. This 
results in potentially significant costs in terms of lost opportunities for organiza- 
tions, especially if the skills in question are rare or in high demand. Such errors 
are additionally costly in terms of the cynicism and sense of unfairness they are 
likely to engender among the individuals who are so misclassified. 

To the above considerations can be added the even more sobering fact that 
there are no “objective” procedures for setting skill or performance standards — 
all such procedures ultimately rely (directly or indirectly) on human judgment. 
However, one can enhance the developmental rigor of the standards-setting pro- 
cess, and hence the ultimate credibility and utility of the resulting system, by 
paying careful attention to the numerous methodological and operational issues 
that affect this judgment process. These issues include such factors as the types 
and qualifications of judges (job incumbents, supervisors, outside subject matter 
experts, etc.); the referent population represented by the judges (i.e., the scope or 
domain of their expertise and the frame of reference implied by this domain — task 
specific, job specific, job-family-wide — which in turn affects both the breadth or 
narrowness of the standard and its content); the number of judges to be used; the 
training provided to judges; and the amount and type of stimulus material and 
instructional information provided to judges. 

The above generic process for deriving and setting skill and certification 
standards is relatively straightforward, if not necessarily easy. However, when 
applied to cross-functional skills, it becomes considerably less straightforward 
because the available evidence suggests that such level setting is much more 
tractable for highly specific skills or knowledge than for more general skills or 
attributes. This is because specific skills and knowledge typically have fairly 
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singular and objectively specifiable behavioral (i.e., performance) referents. For 
example, it is not hard to envision or find examples of definable and differen- 
tiable levels for such specific skills as word processing (through such indices as 
words-per-minute or error-rate levels) or for such specific areas of knowledge as 
emergency medical procedures (such as through degree of mastery, as measured 
by a job knowledge test, of the required component area knowledge, such as 
cardiopulmonary resuscitation or first aid). Nor is it hard to envision the estab- 
lishment of performance standards for given jobs or tasks that can be meaning- 
fully linked to such levels. In such cases the establishment of meaningful perfor- 
mance standards and associated skill or knowledge levels is possible because of 
their more or less objectively specifiable performance referents. 

However, this sort of endeavor is much more problematic when applied to 
cross-functional skills, which have no such unitary or easily specifiable behavioral 
or performance referents. That is, they refer to the ability to perform classes, group- 
ings, or aggregates of more specific tasks, behaviors, or skills. This can be readily 
seen in Table 6-1, discussed earlier, in which information gathering was operation- 
ally defined differently for each of three jobs, depending on the underlying task or 
occupation-specific skill structure. There is thus no unitary performance referent 
for this skill that applies across all the jobs. As I have discussed in more detail 
elsewhere (Pearlman, 1994a), the prospects for our being able to establish meaning- 
ful proficiency levels (for people) that are linked to required performance levels (for 
work or jobs) are at best extremely challenging when cross-functional skills are 
dealt with. Without the type of rigorous underpinnings of work and job analysis 
discussed earlier in this paper, assessment standards for cross-functional skills are 
likely to be either lacking in critical measurement properties (reliability and valid- 
ity) or not very useful for an integrated national system. 

What about the appropriateness and usefulness of a skill certification frame- 
work for cross-functional skills? First, it is important to recognize that the certi- 
fication model has conventionally been used in a criterion-referenced measure- 
ment context. In this context, certification represents attainment or mastery of 
some specifiable and specific — body of knowledge or some unambiguously 
definable and defined — type, amount, or level of skill. Once certified, an indi- 
vidual is expected to have sufficient competence to carry out the basic tasks or 
functions implied by this certification in a manner that assures consumers or 
recipients of the associated product or service of a certain basic level of quality 
and conformance to generally accepted norms or standards of performance. 

As noted above, such a model readily lends itself to application with more 
narrowly defined, occupation-specific skills and knowledge, whereas its applica- 
tion to cross-functional skills, which can connote a multiplicity of performance or 
behavioral referents, is more problematic. For example, what would it mean to be 
certified in “decision making” or “problem solving” (two of the SCANS foundation 
skills) or “works with cultural diversity” or “exercises leadership” (two of the SCANS 
“workplace competencies”)? It would be easy to argue that one can have attained 
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a certain “level” of, or have been “certified” on, such cross-functional skills but still 
not know how to do anything (i.e., in any concrete, job-specific sense). 

It is always somewhat artificial and hence problematic to specify a given 
level of any skill or human attribute that will result in effective versus ineffective 
performance or similar delineations, such as work ready/not work ready, certified/ 
noncertified, or novice/apprentice/journeyman/master/expert. This is because 
work or job performance, however it is measured or operationalized, virtually 
always represents an underlying continuum (i.e., from low to high or poor to 
outstanding), and most human attributes tend to be linearly related to job perfor- 
mance (meaning the more of the attribute possessed, the higher the performance). 
However, the problem is mitigated in the realm of more specialized skills and 
knowledge because of their more objective and specifiable behavioral or perfor- 
mance referents. 

This point also raises the more general concern that, by falsely implying a 
discontinuity of the attribute-performance relationship, skill certifications, if not 
appropriately positioned, or if based on insufficiently rigorous standards, could 
end up inadvertently promoting a minimum competency rather than a 
high-performance mindset, by signaling to students and worker trainees that de- 
velopment or acquisition of a certain amount of a skill or attribute is “enough.” It 
could thus have the unintended effect of constraining rather than promoting both 
upward and lateral occupational mobility and discouraging rather than motivat- 
ing the lifelong growth and development of valued skills. 

Thus, the challenges of operationalizing the measurement of cross-functional 
skills in terms of both instruments and systems that optimize their diagnostic, 
predictive, and evaluative utility are indeed formidable. The near-term success of 
such endeavors is constrained by a number of key limitations in our current 
research and knowledge base, particularly with respect to the mapping of skills 
and knowledge to both the content and the context of the emerging twenty-first 
century world of work. 

There are, nevertheless, some reasons for optimism, at least from a technical 
standpoint, that interim solutions can be developed on the basis of currently 
available methods, instruments, and technology, while the research needed to 
support more rigorous, longer-term solutions (some of which is already under 
way) is being completed. The key elements of such possibilities are outlined 
below. The bigger obstacles are likely to arise at the social and policy levels, 
where, as Thurow (1993) suggests, Americans resist the imposition of national 
standards in general, and local school boards in particular resist the imposition of 
national educational standards and assessments. 



A VISION OF TWENTY-FIRST CENTURY ASSESSMENT 

There is little doubt that widely recognized, highly valued, and commonly 
understood standards of performance excellence are probably the single most 
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important external drivers of individuals’ skill and ability development in both 
our educational institutions and our workplaces. There is also little doubt that 
assessment can play a crucial role in promoting such standards, provided it is 
directed to the right kinds of skills and deployed in a way that motivates, rather 
than disengages, the target populations. What might such a system look like? 
The hypotheses and conclusions drawn throughout this paper suggest that an 
optimal approach to assessment for the twenty-first century workplace might 
consist of the following principles, characteristics, or elements: 

1. A sound basis in empirical, systematic, and comprehensive work and job 
analysis that will have established the following: 

° a clear mapping or linkage between worker-oriented attributes 
(skills-related information categories) and both work content and context across 
the occupational spectrum. 

° well-founded taxonomies of both broader (cross-functional) and narrower 
(occupation-specific skill and knowledge) types of skills-related information. 

° a system of empirically based job families or occupational clusters that 
indicate occupational interrelationships and career lattices in terms of work con- 
tent, work context, and skills-related information and that show which skills are 
transferable and to what degree among occupational areas of subareas. 

2. Adoption of a tiered approach to skill and knowledge development, in 
which: 

° the development of broader skill domains (basic workplace skills and 
cross-functional skills) are targeted for K-12 and vocational-technical institu- 
tions, and more advanced or specialized skill and knowledge domains for 
postsecondary education and specialized training institutions. 

• contemporary principles of education reform (e.g., SCANS, 1992) are 
adopted in K-12 education to incorporate the integration of cross-functional skill 
development with traditional academics. 

• performance-based assessments, in conjunction with locally developed 
and teacher-made assessments, are used within the K- 1 2 domain as tools for diag- 
nosis, student feedback, and development planning but not for skill certification 
or program evaluation. 

3. Establishment of a network of standardized, national assessment centers to 
measure important cross-functional skills; widely deployable and practically fea- 
sible through the use of video-based technology (e.g., video teleconferencing, 
videotaping for later evaluation by others), as well as emerging multimedia-PC- 
based Internet/Web-based technology; with such centers characterized by the 
following: 

° an exclusively individual/developmental focus during grades 9 through 
1 1, with opportunities for multiple “trials, ” detailed feedback and coaching, and 
multiple skill remediation mechanisms and support materials (e.g., lists of key 
experiences and learning activities targeted to particular cross-functional skills). 

\ 
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• an evaluative focus at grade 1 2, with skill-level results used for high-stakes 
purposes (high school diploma, employment recommendations, postsecondary 
referral and placement decisions, institutional evaluation, etc.). 

4. The use of standardized measures of relatively occupation-specific skills 
and knowledge and academic achievement for evaluative purposes (standards 
setting and certification) in secondary and postsecondary education contexts, 
with results used for high-stakes purposes (high school diploma, college or uni- 
versity degree, employment recommendations, postsecondary referral and place- 
ment decisions, institutional evaluation, etc.). 

The above approach suggests some means by which the diagnostic, predic- 
tive, and evaluative/incentive functions of assessment might be usefully inte- 
grated in a manner that is consistent with our current research and knowledge 
base. It combines traditional measurement practices (e.g., paper-and-pencil tests) 
with newer practices and technology in ways that are both technically appropri- 
ate and suitable for the various purposes to which the different types of measures 
would be applied. Although much research is still needed to expand and refine 
our knowledge base with respect to the effective measurement of cross-functional 
skills, the approach suggested above could yield significant educational, social, 
and economic benefits while the needed research continues. 



APPENDIX: CONTENT MODEL 

To help revitalize the American economy, the Advisory Panel for the Dictio- 
nary f of Occupational Titles (APDOT) is recommending a national electronic 
database system that collects, produces, and maintains accurate, reliable, and 
valid information on occupations. The new Database of Occupational Titles 
(DOT) would serve as a national benchmark and provide a common language for 
all users of occupational information. 

The APDOT proposes the following content model as a framework for the 
new DOT. The model is intended to provide a coherent and integrated system that 
identifies the most important types of information about jobs and workers that 
APDOT believes should be considered for inclusion in the new DOT. APDOT 
views this content model as an initial point of departure and as being subject to 
further research and analysis as well as administrative decisions that will be 
made during implementation. APDOT expects that specifics of the descriptors 
will be designed and developed based on future intensive research and that de- 
scriptors will be included when supporting data meet professional standards for 
reliability, validity, and generalizability. 

This content model has been drawn from a thorough analysis of user survey 
results, public comments, and a wide-ranging review of research in such areas as 
job and skill analysis, human individual differences, and organization analysis. 
It embodies a view of occupational analysis that reflects the characteristics of 
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both occupations (through the use of “job-oriented” descriptors) and people 
(through the use of “worker-oriented” descriptors) as well as the broader labor 
market. 

This content model is not intended to imply that information or data regard- 
ing all of its components can or should be collected as part of a single job analysis 
instrument or even as part of the job analysis process. Some information may 
more appropriately lend itself to determination through other forms of research or 
data collection. For example, worker aptitude/ability patterns may be developed 
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through aptitude test validation studies. In addition, some descriptors may be 
obtained through linkages with other databases and information sources. For 
example, the development of such descriptors as occupational outlook informa- 
tion, labor market trends and occupational demographics may be completed by 
linking with appropriate databases developed by sources outside the DOT. 

The content model is organized into four sections intended to represent the 
major elements of a systems model of work: Worker Attributes (Section I), reflect- 
ing input variables; Work Context (Section II), reflecting the organizational, 
social, and physical environment or system in which a job is performed; Work 
Content and Outcomes (Section III), reflecting output variables; and Labor Mar- 
ket Context (Section IV), reflecting the broader economic system of which all 
jobs are a part. The Content Model is shown schematically in Figure 6-A, the 
new DOT content model. Each section defines, provdes examples of, and in some 
cases lists more specific elements of a set of descriptor categories. 

REFERENCES 

Ackerman, P.L. 

1987 Individual differences in skill learning: An integration of psychometric and infor- 

mation processing perspectives. Psychological Bulletin 102:3-27. 

Ackerman, P.L., and L.G. Humphreys 

1990 Individual differences theory in industrial and organizational psychology. Pp. 
223-282 in Handbook of Industrial and Organizational Psychology , 2d ed., vol. 1, M.D. 
Dunnette and L.M. Hough, eds. Palo Alto, CA: Consulting Psychologists Press. 

Advisory Panel for the Dictionary of Occupational Titles 

1993 The New DOT : A Database of Occupational Titles for the Twenty-first Century. Wash- 
ington, DC: U.S. Department of Labor. 

American College Testing 

1991 Work Keys: National System for Teaching and Assessing Employability Skills. Iowa 
City: American College Testing. 

1994 Performing a National Job Analysis Study: Overview of Methodology and Procedure. 
Iowa City: American College Testing. 

American Institutes for Research 

1995 Development of Prototype Occupational Information Network (0*NET) Content Model. 
Salt Lake City: Utah Department of Employment Security. 

Bailey, T. 

1 990 Jobs of the future and skills they will require: New thinking on an old debate. American 
Educator 14(1): 10- 15,40-44. 

Baker, E.L., H.F. O’Neil, Jr., and R.L. Linn 

1 993 Policy and validity prospects for performance-based assessments, American Psychologist 
48:1210-1218. 

Bishop, J.H. 

1988 Employment testing and incentives to learn. Journal of Vocational Behavior 33:404-423. 
Borman, W.C., M.A. Hanson, S.H. Oppler, E.D. Pulakos, and L.A. While 

1993 Role of early supervisory experience in supervisor performance. Journal of Applied 
Psychology 78:443-449. 




186 



176 



2 1 ST CENTURY MEASURES FOR 2 1ST CENTURY WORK 



Borman, W.C., and S J. Motowidlo 

1993 Contextual aspects of job performance. Pp. 71-98 in Personnel Selection in Organiza- 
tions, N. Schmitt, W.C. Borman, and associates, eds. San Francisco- Jossey-Bass 

Bridges, W. 

1994 Job Shift: How to Prosper in a World Without Jobs ■ Reading, MA: Addison- Wesley. 

Burke, M.J., and K. Pearlman 

1988 Recruiting, selecting, and matching people to jobs. Pp. 97-142 in Productivity in Orga- 
nizations , J.P. Campbell, R.J. Campbell, and associates, eds. San Francisco: 
Jossey-Bass. 

Campbell, J.P., JJ. McHenry, and L.L. Wise 

1 990 Modeling job performance in a population of jobs. Personnel Psychology 43:3 1 3-333, 
Campbell, J. P., R. A. McCloy, S.H. Oppler, and C.E. Sager 

1993 A theory of job performance. Pp. 35-70 in Personnel Selection in Organizations , N. 
Schmitt, W.C. Borman, and associates, eds. San Francisco: Jossey-Bass, 

Cappelli, P. 

1 992 College and the Workplace: How Should We Assess Student Performance? Philadelphia: 
National Center for the Educational Quality of the Workforce. 

1995 Is the “Skills Gap ” Really About Attitudes? California Management Review 37(4)- 1 OS- 
124. 

Carnevale, A.P., L.J. Gainer, and A.S. Meltzer 

1988 Workplace Basics: The Skills Employers Want. Washington, DC: American Society for 
Training and Development. 

Coates, J.F., J. Jarratt, and J.B. Mahaffie 

1990 Future Work: Seven Critical Forces Reshaping Work and the Work Force in North 
America , San Francisco: Jossey-Bass. 

Gaugler, B.B., and G.C. Thornton III 

1989 Number of assessment center dimensions as a determinant of assessor accuracy. Journal 
of Applied Psychology 74:61 1-618. 

Gitomer, D.H. 

1992 Cognitive Science Implications for Revising the DOT. In the unpublished report, 
Implications of Cognitive Psychology and Cognitive Task Analysis for the Revision 
of the Dictionary of Occupational Titles, American Psychological Association, Wash- 
ington, DC. 

Gottfredson, L.S. 

1981 A Skills Map: The General and Specific Competencies Required by Different Occupa- 
tions. Progress report. Baltimore: Center for Social Organization of Schools, Johns 
Hopkins University. 

1983 The Validity of an Occupational Classification Based on Job Competencies for Assessing 
Employability. EDRS No. ED 246 239. Baltimore: Center for Social Organization of 
Schools, Johns Hopkins University. 

1986a Occupational aptitude patterns map: Development and implications for a theory of 

job aptitude requirements. Journal of Vocational Behavior 29:254-29 1 . 

1986b Societal consequences of the g factor in employment. Journal of Vocational Behavior 
29:340-362. 

Grubb, N.W., et al. 

1 992 Betwixt and Between: Education , Skills, and Employment in Sub-baccalaureate Labor 
Markets . National Center for Research in Vocational Education Report. Berkeley: Uni- 
versity of California. 

Hough, L.M, 

Development and evaluation of the “accomplishment record” method of selecting and 
promoting professionals. Journal of Applied Psychology 69: 1 35-146. 






1984 



0 

ERIC 



137 



KENNETH PEARLMAN 



177 



Humphreys, L.G. 

1989 Intelligence: Three kinds of instability and their consequences for policy. Pp. 1 93-2 1 6 in 
Intelligence: Measurement, Theory, and Public Policy, R.L. Linn, ed. Urbana: Univer- 
sity of Illinois Press. 

Hunter, J.E. 

1983 A causal analysis of cognitive ability, job knowledge, job performance, and supervisory 
ratings. Pp. 257-266 in Performance Measurement and Theory , F. Landy, S. Zedeck, 
and J. Cleveland, eds. Hillsdale, NJ. Lawrence Erlbaum Associates. 

1986 Cognitive ability, cognitive aptitudes, job knowledge, and job performance. Journal of 
Vocational Behavior 29:340-362. 

Janz, T. 

1989 The patterned behavior description interview: The best prophet of the future is the 

past. Pp. 158-168 in The Employment Interview: Theory , Research and Practice , R.W. 
Eder and G.R. Ferris, eds. Newbury Park, CA: Sage. 

Johnston, W.B., and A.E. Packer 

1987 Workforce 2000. Indianapolis, IN: Hudson Institute. 

Kanfer, R., and P.L. Ackerman 

1 989 Motivation and cognitive abilities: An integrative-aptitude-treatment interaction approach 
to skill acquisition. Journal of Applied Psychology 74:657-690. 

Latham, G.P., L.M. Saari, E D. Pursell,and M.A. Campion 

1980 The situational interview. Journal of Applied Psychology 65:422-427. 

Meridian Corporation 

1991 The Changing World of Work: Implications for the DOT Review Initiative. Report 

prepared for the Advisory Panel for the Dictionary of Occupational Titles. Washing- 
ton, DC: U.S. Department of Labor. 

Michigan Department of Education 

1989 The Michigan Employability Survey. Ann Arbor: Michigan Department of Education. 

Motowidlo, S.J., M.D. Dunnette, and G.W. Carter 

1990 An alternative selection procedure: The low-fidelity simulation. Journal of Applied 
Psychology 75:640-647. 

Motowidlo, S.J., G.W. Carter, M.D. Dunnette, N. Tippins, S. Werner, J.R. Burnett, and M.J. 
Vaughn 

1992 Studies of the structured behavioral interview. Journal of Applied Psychology 77:57 1 -587. 

National Association of Secondary School Principals 

1996 Breaking Ranks: Changing an American Institution. Reston, VA: National Association 
of Secondary School Principals. 

National Center for the Educational Quality of the Workforce 

1994 First Findings: The EQW National Employer Survey. Philadelphia: University of Penn- 
sylvania. 

National Center on Education and the Economy 

1990 America's Choice: High Skills or Low Wages. Rochester, NY: National Center on 
Education. 

National Commission on Excellence in Education 

1983 A Nation at Risk: The Imperative for Educational Reform. Washington, DC. U.S. 
Government Printing Office. 

National Governors’ Association 

1992 Enhancing Skills for a Competitive World. Washington, DC: National Governors Asso- 
ciation. 

Naughton, T.J., and D. Outcalt 

Development and test of an occupational taxonomy based on job characteristics 
theory. Journal of Vocational Behavior 32: 1 6-36. 



1988 



3 

ERIC 



133 



178 



21 ST CENTURY MEASURES FOR 2 1ST CENTURY WORK 



Neidig, R.D., and P.J. Neidig 

1984 Multiple assessment center exercises and job relatedness. Journal of Applied Psychology 
69:182-186. 

Offerman, L.R., and M.K. Gowing 

1993 Personnel selection in the future: The impact of changing demographics and the nature of 
work. Pp. 385-417 in Personnel Selection in Organizations, N. Schmitt, W.C. Borman, 
and associates, eds. San Francisco: Jossey-Bass. 

Olsten Forum on Human Resource Issues and Trends 

1994 Skills for Success. Westbury, NY: Olsten Corp. 

O’Neill, H.F., Jr., K. Allred, and E.L. Baker 

1992 Measurement of Workforce Readiness: Design of Prototype Measures. CSE Technical 
Report 344. Los Angeles: Center for the Study of Evaluation and National Center for 
Research on Evaluation, Standards, and Student Testing, University of California. 

Pearlman, K. 

1980 Job families: A review and discussion of their implications for personnel selection. 

Psychological Bulletin 87:1-28. 

1993 The Skills Standards Project and the Redesign of the Nation’s Occupational Classifi- 
cation System. Unpublished paper prepared for the U.S. Department of Labor, 
contract no. 93-509, by Western Test Development Center, Utah Department of 
Employment Security, Salt Lake City. 

1994a The Development of Occupational/Skill Clusters for Goals 2000: Suggested Ap- 

proaches and Key Issues. Unpublished paper prepared for the U.S. Department of 
Labor under contract to DTI, 2361 Jefferson Davis Highway, Suite 500, Arlington 
VA 22202. 

1994b Job Families in the United States Employment Service: Review, Analysis, and Recom- 
mendations. Unpublished technical report prepared for the U.S. Department of Labor, 
contract no. 92-442, by Western Test Development Center, Utah Department of Employ- 
ment Security, Salt Lake City. 

1995 Is “Job” Dead? Implications of Changing Concepts of Work for I/O Science and 
Practice. Panel discussion conducted at the 10th annual conference of the Society for 
Industrial and Organizational Psychology, Orlando, FL, May. 

Reich, R.B. 

1991 The Work of Nations : Preparing Ourselves for 2 1st Century > Capitalism. New York: 
Alfred A. Knopf. 

Russell, C.J. 

1987 Person characteristic versus role congruency explanations for assessment center 
ratings. Academy of Management Journal 30:8 1 7-826. 

Sackett, P.R., and G.F. Dreher 

1982 Constructs and assessment center dimensions: Some troubling empirical findings. Jour- 
nal of Applied Psychology 67:40 1 -4 1 0. 

1984 Situation specificity of behavior and assessment center validation strategies: A 

rejoinder to Neidig & Neidig. Journal of Applied Psychology 69: 1 87- 1 90. 

Schmidt, F.L., and J.E. Hunter 

1992 Development of a causal model: Processes determining job performance. Current Direc- 
tions in Psychological Science 1 : 89-92. 

Schmidt, F.L., J.R. Caplan, S.E. Bemis, R. Decuir, L. Dunn, and L. Antone 

1979 The Behavioral Consistency Method of Unassembled Examining. Washington, DC: Of- 
fice of Personnel Management. 

Schmidt, F.L., J.E. Hunter, and A.N. Outerbridge 

1986 Impact of job experience and ability on job knowledge, work sample performance, and 
supervisory ratings of job performance. Journal of Applied Psychology 1 1 :432-439. 




183 



KENNETH PEARLMAN 



179 



Secretary’s Commission on Achieving Necessary Skills 

1991 What Work Requires of Schools : A SCANS Report for America 2000. Washington, DC: 
U.S. Department of Labor. 

1992 Learning a Living: A Blueprint for High Performance: A SCANS Report for America 
2000. Washington, DC: U.S. Department of Labor. 

Thornton, G.C., III, and W.C. Byham 

1982 Assessment Centers and Managerial Performance. New York: Academic Press. 

Thurow, L. 

1993 Unpublished speech presented at the Business for Social Responsibility Conference, 
Washington, DC, October 21. 

Tucker, M.S. 

1993 Prepared Remarks on Title IV, Goals 2000: Educate America Act before the House 
Subcommittee on Elementary’, Secondary, and Vocational Education. Rochester, NY. 
National Center on Education and the Economy. 

U.S. Department of Labor 

1977 Dictionary of Occupational Titles, 4th ed. Washington, DC: U.S. Department of Labor. 

1979a Guide for Occupational Exploration. Washington, DC: U.S. Department of Labor. 

1979b Manual for the USES General Aptitude Test Battery. Section II: Occupational Aptitude 
Pattern Structure. Washington, DC: U.S. Department of Labor. 

1979c Manual for the USES General Aptitude Test Battery. Section II-A: Development of the 
Occupational Aptitude Pattern Structure. Washington, DC: U.S Department of Labor. 

198 1 Selected Characteristics of Occupations Defined in the Dictionary of Occupational Titles. 

Washington, DC: U.S. Department of Labor. 

1991 Dictionary of Occupational Titles , 4th ed., rev. Washington, DC: U.S. Department of 
Labor. 

Van Horn, C. 

1995 Enhancing the Connection Between Higher Education and the Workplace. A Survey of 
Employers. Denver: State Higher Education Executive Officers and the Education Com- 
mission of the States. 

Wetrogan, L.I., D M. Olson, and H.M. Sperling 

1983 A Systemic Model of Work Performance. Unpublished paper presented at the 91st 
annual meeting of the American Psychological Association, Anaheim, CA, August. 





7 



Postmodern Test Theory 



Robert J. Mislevy 



Good heavens! For more than forty years I have been speaking prose'without 
knowing it. 



Moliere, Le Bourgeois Gentilliomme 



INTRODUCTION 

Moliere s Monsieur Jourdan was astonished to learn that he had been speaking 
prose all his life. I know how he felt. For years I have just been doing my job- 
trying to improve educational assessment by applying ideas from statistics and 
psychology. Come to find out, I’ve been advancing “neopragmatic postmodernist 
test theory” without ever intending to do so. This paper tries to convey some sense 
of what this rather unwieldy phrase means and offers some thoughts about what it 
implies for educational assessment, present and future. The goods news is that we 
can foresee some real improvements: assessments that are more open and flexible, 
better connected with students’ learning, and more educationally useful. The bad 
news is that we must stop expecting drop-in-from-the-sky assessment to tell us, in 2 
hours and for $10, the truth, plus or minus two standard errors. 

Gary Minda’s (1995) Postmodern Legal Movements inspired the structure of 
what follows. Almost every page of his book evokes parallels between issues and 
new directions in jurisprudence on the one hand and the debates and new develop- 
ments in educational assessment on the other. Excerpts from Minda’s book frame the 
sections of this paper. They sketch out central ideas in postmodernism — neoprag- 
matic postmodernism, in particular— and how they are transforming the theory and 
practice of law. Their counterparts in assessment are discussed in turn. 



Modernism and Postmodernism 

This section introduces the terms “modernism,” “postmodernism,” and “neo- 
pragmatic postmodernism” as I will use them. It is necessarily incomplete, and 
adherents of each position will find much to disagree with. 
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Modernism 

Modern legal theorists believe that they can discover the “right answers” or 
“correct interpretation” by applying a distinctive legal method based on deduc- 
tion, analogy, precedent, interpretation, social policy, institutional analysis, his- 
tory, sociology, economics, and scientific method. . . . Legal moderns 
express the intellectual and artistic quest for perfection through the process of 
uncovering and unmasking the secrets of the world by transcending contexts 
that limit human understanding. . . . Legal modernism also ... is based on an 
understanding of language that assumes that words and conceptual ideas are 
capable of objectively capturing the meaning of events the law seeks to describe 
and control. (Minda, 1995:5-6) 

To Plato the nature and intelligibility of the world of appearance could be 
accounted for only by recognizing it as an “image” of the truly intelligible struc- 
ture of being itself. These “forms” are the essence of being in the world, although 
we experience only images or imperfect instances of this or that. He likened our 
condition to that of dwellers in a cave, who see shadows on cave walls but not the 
objects that cast them. The struggle, by means of logic and the scientific method, 
to infer the universe’s “true” forms and to explicate their invariant relationships 
to experience characterizes what we may call the modern approach. 

Modernism in physics, for example, can be illustrated by the prevailing 
belief, up through the beginning of the twentieth century, that objects exist in a 
fixed Euclidean space and interact in strict accordance with Newton’s laws. 
Measurement was a matter of characterizing properties of objects such as their 
mass and velocity — with uncertainty to be sure but only from the imperfections 
of our measuring devices. The variables were the universe’s; the distance be- 
tween our knowledge and the truth was quantified by a standard error of measure- 
ment and shrank toward zero as we fine-tuned our models and improved our 
instruments. 

In law the essence of modernism is the idea that “there is a ‘real’ world of 
legal system ‘out there,’ perfected, formed, complete and coherent, waiting to be 
discovered by theory” (Minda, 1995:224). The source was debated, to be sure: 
Dean Christopher Columbus Langdell (in' 1871) maintained that careful study of 
cases should reveal the underlying axioms of justice, from which “the law” in its 
entirety follows logically. Oliver Wendell Holmes argued pragmatically that 
“law and its institutions evolved from views of public policy, social context, 
history, and experience” (Minda, 1995:18) and that its application always relies 
on judgments about its role in society. 

In educational and psychological testing, modernism corresponds to the pur- 
suit of models and methods that characterize people through common variables, 
as evidenced by common observations — under the conceit that there are objec- 
tively correct ways of doing so. The source of these models and variables has 
been debated over the years along logical versus pragmatic lines analogous to the 
Langdell versus Holmes stances. Witness on the one hand, factor analytic re- 
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search programs that seek to “discover” the nature of intelligence and personality 
(e.g., Spearman, 1927; Thurstone, 1947) and, on the other, painstaking consen- 
sus-building procedures for assembling item pools to “measure achievement” in 
subject domains (e.g., Lindquist, 1951). These distinct branches within modern 
test theory correspond to the trait and behaviorist psychological perspectives. 
Under both perspectives, care is taken (1) to define, from the assessor’s point of 
view, contexts in which to observe students; (2) to specify, from the assessor’s 
perspective, the ways in which students’ behavior will be summarized; and (3) to 
delineate the operations through which the assessor can draw inferences, within 
the assessor’s frame of reference. 



Postmodernism 

In jurisprudence, postmodernism signals the movement away from “Rule of 
Law” thinking based on the belief in one true “Rule of Law,” one fixed “pat- 
tern,” set of “patterns,” or generalized theory of jurisprudence. ... As devel- 
oped in linguistics, literary theory, art, and architecture, postmodernism is also 
a style that signals the end of an era, the passing of the modern age . . . des- 
cribing what happens when one rejects the epistemological foundations of 
modernity. (Minda, 1995:224) 

Wittgenstein’s view of language is that all of our language has meaning only 
within the language games and “forms of life” in which they are embedded. 

One must understand the use, the context, the activity, the purpose, the game 
which is being played. . . . (Minda, 1995:239) 

The notion of discourse plays a central role in postmodernism. Language 
generates our “universe of discourse”: the kinds of things we can talk about and 
the particular things we can say; what we construe as problems, how we attempt 
to solve them, and how we evaluate our success. But what is the source of words 
and concepts? Postmoderns claim that the commonsense idea that meanings of 
words reside “in” language is fundamentally misguided. For them, language 
constructs, rather than reflects, the meaning of things and events in the world 
(Minda, 1995:239). 

Relativity and the quantum revolution shattered the belief that Newtonian 
and Euclidean models were the correct ultimate description of the universe. Ironi- 
cally, improved instrumentation devised to finalize the modern research program 
revealed that its fundamental models were not in fact the universe’s. Mathemati- 
cal descriptions of observations departed increasingly from such intuitive notions 
as simultaneity and definitive locations of persistent entities. Just as ironically, 
while we obtain better accuracy in modeling phenomena and more power to solve 
applied problems than the “modern” physicists of the nineteenth century dreamed, 
we feel farther away from ultimate understanding. The universe is not only stranger 
than we imagine, mused the mathematician J.B.S. Haldane, it is stranger than we 
can imagine! 
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Just as relativity and quantum mechanics gave rise to postmodern physics, 
Minda noted several diverse movements that provoked a postmodern era in law 
in the 1980s: law and economics, critical legal studies, feminist legal theory, law 
and literature, and critical race theory. Cognitive psychology was the analogous 
shock to educational assessment— in particular, recognition of the crucial roles of 
students’ perspectives in learning and of the social settings in which learning 
takes place. Snow and Lohman (1989:317) put it this way: 

Summary test scores, and factors based on them, have often been thought of as 
“signs” indicating the presence of underlying, latent traits. ... An alternative 
interpretation of test scores as samples of cognitive processes and contents, and 
of correlations as indicating the similarity or overlap of this sampling, is equally 
justifiable and could be theoretically more useful. . . . Whatever their practical 
value as summaries, for selection, classification, certification, or program eval- 
uation, the cognitive psychological view is that such interpretations no longer 
suffice as scientific explanations of aptitude and achievement constructs. 



Neopragmatic Postmodernism 

Some postmodernists have adopted a neopragmatic outlook as an antidote to 
the postmodern condition. These postmodern critics are skeptical of the truth 
claims of modern theory, but they have not given up on theory. On the con- 
trary, they believe that theory can have utility when used as a tool for the 
empirical investigation of problems. . . . Its practitioners accept the postmodern 
view that truth and knowledge are culturally and linguistically conditioned. On 
the other hand, neopragmatist practice is unlike . . . what some theorists call 
poststructuralist criticism because it is less concerned with exposing the contra- 
dictions of modern conceptual and normative thought than revealing instrumen- 
tal, empirical, and epidemiological solutions for the problem at hand. (Minda, 
1995:229-230) 

Minda distinguishes “neopragmatic” postmodernists from “ironic” post- 
modernists, the latter of which “embrace the predicaments and paradoxes of the 
current intellectual condition in order to better understand the world of legal, 
social, and philosophical thought, and they attempt to bring out the irony of the 
experience of living in a postmodern world” (1995:4-5). In legal theory “the 
ironists attempt to facilitate the crisis and fragmentation of modern theory by 
employing postmodern criticism to ‘displace, decenter, and weaken’ central con- 
cepts of modern legal Western thought” (1995:230). In the fine arts, ironic 
postmodernism is rather de rigueur. Physics and, by extension, engineering 
demand a neopragmatic stance. Models and variables may indeed be our cre- 
ations rather than nature’s, and they are ever subject to alternatives and revi- 
sions — but we must in some way accommodate the constraints nature imposes 
upon us as we struggle with the challenges we confront. And if there is a job to do, 
languages, models, and conceptual frameworks are what we have to work with. 
Like law, educational assessment lies somewhere between literature and 
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physics. Cognitive research reveals recurrent patterns in the ways people learn 
and solve problems, yet what is important to learn and the conditions under which 
it will be learned are largely socially determined. “Neopragmatic postmodern 
test theory explores the potential of using methodological and inferential tools 
that originated in a modern perspective to support learning in ways conceived in 
a postmodern perspective. 



MODERN TEST THEORY 
Technical Considerations 

Legal modernism also ... is based on an understanding of language that 
assumes that words and conceptual ideas are capable of objectively capturing the 
meaning of events the law seeks to describe and control” (Minda, 1995:6). 

Most familiar practices of educational assessment can be traced to the first 
third of the twentieth century. Their forms were shaped by constraints on gather- 
ing and handling data in that era and by purposes conceived under then-current 
beliefs about learning and schooling. A paradigm of mental measurement analo- 
gous to classical (read “modern”) physical measurement developed, and the tools 
of test theory evolved to guide applied work within this setting — designing tests, 
characterizing their evidential value, and evaluating how well they achieved their 
intended purposes. The targets of inference are aspects of students’ learning, 
characterized as numbers on a continuum, upon which evaluations and decisions 
would be based if they were known with certainty. 

In his 1961 article “Measurement of learning and mental abilities,” Harold 
Gulliksen (1961:9) characterized the central problem of test theory as “the rela- 
tion between the ability of the individual and his observed score” Referring 
explicitly to Plato’s cave, he said “the problem is how to make the most effective 
use of these shadows (the observed test scores) in order to determine the nature of 
reality (ability) which we can only know through these shadows.” The purposes 
of test theory, in this view, are to guide the construction of assessment elements 
and events (i.e., domains of test items and test conditions) and to structure infer- 
ence from students’ behavior in the resulting situations. The modernist underpin- 
nings of the enterprise are reflected in a quotation from Gulliksen’ s (1961:101- 
102) review of test theory on the occasion of the twenty-fifth anniversary of the 
Psychometric Society, concerning the search for the “right” item-response-theory 
models: 

An attempt to develop a consistent theory tying test scores to the abilities mea- 
sured is typified by Lord’s (1952) recent work ... in which he formulated at least 
five different theories of the relationship between test scores and abilities, and 
showed how it was possible to test certain ones of these. It is to be hoped that 
during the next 10 or 20 years a number of these tests will be carried out so that 
we will have not five different theories of the relationship between ability and test 
score and various possible trace lines, but we will be able to say that, for certain 
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specified tests constructed in this way, here is the relationship between the score 
and the ability measured, and this is the appropriate trace line to use. 



Social Considerations 

“Neopragmatists believe that theory merely establishes the rules for playing 
a particular language game” (Minda, 1995:236). 

Although the physical measurement analogue connotes a certain objectivity 
and detachment, assessment based on the modernist approach nevertheless shapes, 
and is shaped by, social considerations. It structures conversations about learning 
in several ways: 

• Communication of expectations. In and of themselves, domains of tasks 
and modes of testing convey, to students, teachers, and the public at large, what is 
important for students to learn and to accomplish. 

• Communication of results. Once a domain of tasks and conditions of 
observation have been specified, a score and an accompanying measure of preci- 
sion give a parsimonious summary of a student’s behavior in the prescribed con- 
texts that is easily transmitted across time and place. 

• Credibility of results. Test scores earn credibility beyond the immediate 
circumstances of the assessment if the data have been verifiably gathered under 
prescribed conditions. 

That traditional assessment procedures serve these purposes is quite inde- 
pendent of the fact that they evolved under the mental measurement paradigm. 
Any procedures that might rise in their stead to assess and communicate students’ 
learning would, in some way, need to address the same functions. 



PROGENITORS OF CHANGE 

The transition from the old to the ‘new’ jurisprudence began with the break- 
down of the core beliefs and theories that served to define modern jurispru- 
dence. The breakdown is partly a manifestation of the proliferation of new 
jurisprudential discourses and new movements in legal thought. (Minda, 
1995 : 243 ) 

I claimed earlier that developments in the psychology of learning and cogni- 
tion brought about a postmodern era in assessment, and I shall say more about 
that later. These developments do indeed lay the groundwork for new develop- 
ments in assessment, but I do not believe they were sufficient in and of them- 
selves to change the field. Had modem testing seen satisfactory progress in its 
research agenda, there would have been less impetus for change. But in assess- 
ment, as in physics, improved methodology and inferential methods led away 
from, rather than toward, the anticipated solutions. 
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Developments in Methodology 

There is a rising sentiment in the legal academy that modern legal theory 
has failed to sustain the modernists’ hopes for social progress” (Minda, 1995:248). 

Twenty-five years after Gulliksen’s article, Charles Lewis observed that 
much of the recent progress in test theory has been made by treating the study of 
the relationship between responses to a set of test items and a hypothesized trait 
(or traits) of an individual as a problem of statistical inference” (Lewis, 1986). 
New modeling and inferential techniques included item response theory, 
generalizability theory (Cronbach et al., 1972), structural equations modeling 
(e.g., Joreskog and Sorbom, 1979), and the application of more powerful estima- 
tion methods from the statistical literature (e.g., Bock and Aitkin, 1981). They 
provided solutions to previously intractable problems such as tailoring tests to 
individual examinees and sorting out relationships in patterns of achievement test 
scores in hierarchical schooling systems. 

These developments make for more efficient gathering of evidence and more 
powerful forms of argumentation for addressing questions that could be framed 
within the universe of discourse of modern test theory. But by requiring analysts 
to more clearly explicate their targets of inference and how observations provided 
evidence about them, these advances in modern test theory began to reveal im- 
portant problems that lie beyond the paradigm’s reach. The following two ex- 
amples illustrate the point: 

* How can we measure change, or can we? Through the use of standard test 
theory, evidence can be characterized and brought to bear on inferences about 
students overall proficiency in behavioral domains, for determining students’ 
levels of proficiency, comparing them with others or with a standard, or gauging 
changes from one point in time to another. Cronbach and Furby (1970:76) 
cautioned that characterizations about the nature of this proficiency or how it 
develops fall largely outside the paradigm’s universe of discourse: 

Even when [test scores] X and Y are determined by the same operation [e.g., a 
true-score or item-response-theory model for a specified domain of tasks], they 
often do not represent the same psychological processes. At different stages of 
practice or development different processes contribute to the performance of a 
task. Nor is this merely a matter of increased complexity; some processes drop 
out, some remain but contribute nothing to individual differences within an age 
group, some are replaced by qualitatively different processes. 

• Differen tial item functioning (DIF). Classical test theory took test scores 
at face value, treating all response patterns with the same total score as identical. 
Item response theory explicated the conditions that would have to hold among 
patterns of item responses for total scores to capture all nonrandom variations 
among students. Essentially, the same expectation of success on each given task 
would have to hold for all students at a given true-score level, regardless of item 
content or students’ background characteristics. Differential-item-functioning 
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techniques devised to check these conditions often found that they failed in 
achievement tests — most importantly, in ways that related to curriculum (e.g., 
Miller and Linn, 1988) and solution strategies (e.g., Birenbaum and Tatsuoka, 
1983; French, 1965). Because what is hard and what is easy is not universal — 
they depend, not surprisingly, on what and how students have been studying — 
summary scores inevitably fail to characterize some aspects of students’ knowl- 
edge and progress. 



Developments in Psychology 

Cronbach and Furby’s comments on measuring change presaged a growing 
awareness that domain-referenced assessment methodologies, including item re- 
sponse theory, were simply not rich enough to support discourse about the nature 
and progress of students’ learning. In assessment, as in physics, however, merely 
recognizing inadequacies in a paradigm is not sufficient for change. Newton and 
Huygens debated the contradictory wave- and particle-like properties of light as 
early as the seventeenth century. Paradigms are not displaced by data, the saying 
goes; paradigms are displaced only by other paradigms. Conceptions of learning 
that ground a broader universe of discourse for assessment are emerging from 
cognitive and educational psychology. The following paragraphs review some 
key insights into the ways people acquire and use knowledge and skills. Each, it 
will be noted, accents the uniquely personal and socially conditioned nature of 
learning. 

• Mental models/schema theory. A “mental model” or “schema” is a pat- 
tern of recurring relationships — anything from what happens at birthday parties 
to how to figure out unit prices to how to carry out conversations — with variables 
that correspond to particular ways the pattern can occur. Some schemas are 
informal and intuitive; others we learn in part formally and explicitly. David 
Rumelhart (1980:55) claims that schemas 

play a central role in all our reasoning processes. . . . Once we can “under- 
stand” the situation by encoding it in terms of a relatively rich set of schemata, 
the conceptual constraints of the schemata can be brought into play and the 
problem readily solved. 

No cognition is purely passive or data driven; we always construct meaning in 
terms of knowledge structures. Learning sometimes means adding bits to exist- 
ing structures; sometimes it involves generalizing or connecting schemas; other 
times it involves abandoning important parts of schemas and replacing them by 
qualitatively different structures. 

• How expertise develops . While experts in various fields of learning 
generally command more facts and concepts than novices, the real distinc- 
tion lies in their ways of viewing phenomena and representing and approach- 
ing problems (e.g., Chi et al., 1981). Experts learn to work from what 
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Greeno (1989) calls the “generative principles of the domain,” and they 
automatize recurring procedures (they “compile knowledge”) so that they 
can devote their attention to novel aspects of problems. Increasing 
metacognitive skills” also mark developing expertise: self-awareness in 
using models and skill and flexibility in how to construct them, modify 
them, and adapt them to problems. 

° Situated learning. Assessment has focused on aspects of learning that are 
characterized insofar as possible as properties of individual students. Yet the 
nature of the knowledge we construct is conditioned and constrained by tech- 
nologies, information resources, and social situations as we learn about tools, 
physical and conceptual, and how and when to use them. For example, reading 
comprehension depends on one's competence in recognizing words and parsing 
syntactic structures, but it also depends as much on am understanding of the 
context and substance of what the message is about. Students who have similar 
competences with structural aspects of language can take vastly different mean- 
ings away from the same text, depending on their experience with the phenomena 
in question. These findings, along with those discussed above, argue that learn- 
ing is more richly characterized in terms of the student's breadth and configura- 
tions of connections across social and substantive contexts than by success in a 
given domain of tasks — even though such success occurs only by virtue of those 
connections. 

These cross-cutting generalizations should not obscure the fact that cogni- 
tive psychology is a fractured, often fractious, field. Competing claims of rival 
researchers differ from one another as much as all differ from the trait and behav- 
iorist perspectives. This is largely because different researchers are exploring 
different ranges of behavior, acquired and used under different circumstances. 
Bimbaum (1991:65) suggests: 

Problem-solving depends on the manipulation of relatively fragmented and mutu- 
ally inconsistent microtheories — each perhaps internally consistent, and each 
constituting a valid way of looking at a problem: “This will allow us to say, for 
example, that some [set of beliefs] is more appropriate than some [other set of 
beliefs] when confronted with problems of diagnosing bacterial infections. Scien- 
tists are used to having different — even contradictory — theories to explain reality. 

. . . Each is useful in certain circumstances.” (Nilsson, 1991 :45) 

In assessment, as in law, the neopragmatic postmodernist welcomes all these 
lines of research as potentially useful tools for solving different practical prob- 
lems; that is to say: 

For postmodern legal scholars, choosing the “best” answer for legal problems 
requires “tactical” judgments and questions regarding the values of the decision 
maker much more than a quest for a so-called “best” argument. One conse- 
quence of this has been the realization that there exists a multiplicity of answers 
for law’s many problems. (Minda, 1995:252) 
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Rapprochement 

Good teachers have always relied on a wider array of means to learn about 
how the students in their classes are doing and to help plan further learning. 
Alongside the tests and quizzes they design and score under the mental measure- 
ment paradigm, they also use evidence from projects, work in class, conversations 
with and among students, and the like — all combined with additional informa- 
tion about the students, the schooling context, and what the students are working 
on. Teachers call these “informal” assessments, in contrast with the “formal” 
assessments typified by large-scale standardized tests. 

The stark contrast between formal and informal assessment arises because to 
understand students’ learning and further guide it, teachers need information 
intimately connected with what their students are working on, and they interpret 
this evidence in light of everything else they know about their students and their 
instruction. The power of informal assessment resides in these connections. 
Good teachers implicitly exploit the principles of cognitive psychology, broad- 
ening the universe of discourse to encompass local information and address the 
local problem at hand. Yet precisely because informal asessments are thus indi- 
viduated, neither their rationale or their results is easily communicated beyond 
the classroom. Standardized tests do communicate efficiently across time and 
pl ace — but by so constraining the universe of discourse that the messages often 
have little direct utility in the classroom. 

The challenge now facing neopragmatic postmodern test theory is to devise 
assessments that, in various ways, incorporate and balance the strengths of formal 
and informal assessments by capitalizing on an array of methodological, techno- 
logical, and conceptual developments. 



POSTMODERN TEST THEORY 

“Postmodern legal critics employ local, small-scale problem-solving strate- 
gies to raise new questions about the relation of law, politics and culture. They 
offer a new interpretive aesthetic for reconceptualizing the practice of legal inter- 
pretation” (Minda, 1995:3). 

Cognitive psychology challenges the adequacy of the “one-size-fits-all” pre- 
sumption of standard assessment, which defines the target of inference in terms 
of an assessor-specified domain of tasks, to be administered, scored, and inter- 
preted in the same way for all students. The door has been opened to alternative 
ways to characterize students’ proficiency and acquire evidence about it — ways 
that may involve observing students in different situations, interpreting their 
actions in light of additional information about them,- or triangulating across 
context and situation, as may be required for one’s purpose (Moss, 1996). 

Moss (1994) and Delandshere and Petrosky (1994) offer postmodern in- 
sights into assessment from a less structural perspective than mine, criticizing test 
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theory as it is conceived from a modernist point of view. I am interested in the 
utility of model-based inference in assessment, as ^conceived from a 
postmodernist point of view. I submit that concepts from psychology and infer- 
ential tools from model-based reasoning can support assessment practice as more 
broadly conceived just as Newton’s laws still guide bridge design, quantum 
mechanics and relativity theory notwithstanding. The essential elements of the 
approach are (1) understanding the important concepts and relationships in the 
learning area in order to know the aspects of students we need to talk about in the 
universe of discourse our assessment will generate and (2) determining what one 
needs to observe and how it depends on students’ understandings, so as to struc- 
ture assessment settings and tasks that will provide evidence about the above- 
mentioned aspects of students’ understandings. Here is an example from a project 
I have been working on recently, concerning advanced placement (AP) studio art 
portfolios. 

Viewed only as measurement, the AP studio art portfolio program would be 
a disaster. Students spend hundreds of hours creating the portfolios they submit 
for scoring at the end of the year, and raters who are art educators and teachers 
spend hundreds of hours evaluating the work— all to produce reliability coeffi- 
cients about the same as those of 90-minute multiple-choice tests. The situation 
brightens when the program is viewed as a framework for evidence about skills 
and knowledge, around which teachers build art courses with wide latitude for 
topics, media, and projects. A common understanding of what is valued and how 
it is evaluated in the central scoring emerges through teacher workshops, talked- 
through examples with actual portfolios, and continual discussions about how to 
cast and apply rating rubrics to diverse submissions. Meaning emerges through 
countless conversations across hundreds of classrooms, each individual but with 
some common concepts and shared examples of their use — each enrichened and 
individuated locally in a way that grounds instruction and local evaluations but 
with a common core that grounds more abbreviated program-wide evaluations. 
This is, at heart, a social phenomenon, not a measurement phenomenon. Carol 
My ford and I have found an item-response-theory measurement model for ratings 
valuable, nevertheless, to illuminate how raters use evaluative criteria and to 
characterize uncertainty about students’ scores (My ford and Mislevy, 1995). We 
do not use the model to “gauge the accuracy of a measuring instrument.” We use 
it to survey patterns of similarity and variation, of agreement and disagreement, 
among tens of thousands of virtual dialogues among students, raters, and teach- 
ers, through their portfolios — to the end of discovering sources of misunderstand- 
ing and cross talk that can frustrate the conversations. 

Model-based reasoning is useful not so much for characterizing the unique 
essence of a phenomenon but as a tool of discourse — for organizing our thinking, 
for marshaling and interpreting evidence, and for communicating our inferences 
and their grounding to others. The discipline that model-based reasoning de- 
mands even benefits us when we don’t believe the models are true: it is easier to 
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notice phenomena that don’t accord with the patterns we expect to see and, 
therefore, to revise our thinking. A skeptical attitude about models in assessment 
makes our uses of them more flexible, more powerful, and, ultimately, more 
effective at meeting and fulfilling the aims of education than they would be if we 
believed that they accurately captured the totality of the phenomenon. 

From a modernist perspective. Lord Kelvin declared at the turn of the century 
that “when you can measure what you are speaking about, and express it in 
numbers, you know something about it; but when you cannot measure it, when 
you cannot express it in numbers, your knowledge is of a meager and unsatisfac- 
tory kind.” Measurement, in his eyes, was a one-off representation of truth. 
From a postmodern perspective, even if you can measure, your knowledge is still 
meager in a fundamental sense but at least you have a practicable framework for 
discourse — for structuring action, for communicating your observations and your 
reasoning, for struggling with practical problems, for surprising yourself in ways 
that lead to further understanding. Lord Kelvin’s quote is a modernist scientific 
version of Yogi Berra’s “it ain’t over ‘til it’s over.” The postmodern response is 
Jesse Jackson’s “and even then it ain’t over.” 



SOME IMPLICATIONS OF A POSTMODERN PERSPECTIVE 

Neopragmatists thus attempt to explain how one can do theoretical work with- 
out rejecting all pretenses of foundational knowledge. Neopragmatists argue 
that the theorists must take a situated stance in their scholarship and adopt an 
instrumental approach to theory. Whatever works in context becomes the stan- 
dard for their theoretical investigation and judgment. . . . When applied to legal 
studies, neopragmatism forms the academic perspective of scholars who reject 
all foundational claims of legal theory but remain committed to the view that 
legal theory can be useful for solving legal problems. . . . Neopragmatists thus 
believe in and are committed to the Enlightenment idea of progress, even while 
they resist using the modernist’s framework. (Minda, 1995:230) 

In the remainder of the main body of the paper, I offer comments from a 
neopragmatic postmodern perspective on enhancing familiar kinds of assess- 
ment, even while moving our interpretational perspective beyond its modernist 
roots. As an example, I address the question of the degree to which “adult 
literacy,” an essential element of workplace skill, can be defined and gauged 
across literacy training programs. 

Progress Within Modern Test Theory 

Familiar forms of assessment were shaped by constraints on how data could 
be gathered, stored, transmitted, and analyzed. Logistical and economic pres- 
sures limited the large-scale use of essays and interviews that required human 
interpretation, thus favoring objective-response tasks over more constructive and 
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sustained tasks. It was not possible to store or share ephemeral performances in 
order to develop common standards or to verify that ratings were fair. These 
constraints are being eased by technological developments — computers, video- 
taping and audiotaping, electronic communication, mass storage, and access to 
resources. Some new possibilities appear even within the traditional mental mea- 
surement paradigm. I will mention some briefly but then argue that technology 
alone will not break through the essential inferential barriers of the modernist test 
theory perspective: 

° New kinds of tasks and scoring. Computers can present students with 
tasks that are interactive (e.g., simulated experiments), dynamic (e.g., medical 
treatment problems in which simulated patients’ conditions change over time), 
constructive (e.g., a stimulated construction site onto which elements must be 
moved to meet client’s needs), and less tightly structured (e.g., a word problem 
that is to be approached in many ways). Some scoring can be also done automati- 
cally, including for these examples. 

° Distributed testing and scoring. Students’ responses to computerized 
tasks can now be captured and electronically transmitted. Performances can be 
videotaped and audiotaped. Constructed paper-and-pencil responses and artwork 
can be scanned. Students can thus be assessed in remote places and at different 
times, and raters can evaluate their performances in remote places and at different 
times. Students in school consortiums can share work on a common project, 
interacting with, and receiving feedback from, teachers and students across the 
nation. 

° “ Replayability ” (Frederiksen and Sheingold, 1994). Beside easing con- 
straints on time and location, capturing performances helps address the rater- 
agreement problems that troubled Horace Mann more than a century ago. Perfor- 
mances can now be seen, discussed, and evaluated by as many people, in as many 
times and places, as desired. Now that we are no longer limited to the evaluations 
of raters present at the original performance, we can have broader and more inter- 
connected scoring of individual students and use exemplars to establish shared 
expectations and standards of evaluation, over time and across distance, among 
raters, teachers, and students. 

Despite technology and efficient statistical models, the objective of charac- 
terizing students’ proficiency must remain poorly met if one is constrained to 
one-size-fits-all data and to ignorance of contextual and educational background 
factors. The more examinees differ as to relevant contextual and experiential 
factors, the more likely it is that each task in a complex and context-rich domain 
will consume considerable time and costs without providing much information 
about how students would fare on other tasks — the Shavelson et al. (1992) “low 
generalizability” problem (also see Linn, 1993). Each individual task may pro- 
vide copious information for some inferences — but not for inferences about the 
usual target, domain-true score. The same complex task can be invaluable in an 
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assessment linked with instruction and grounded in context yet worthless in a 
broadly cast survey because it is trivial, unapproachable, or incomprehensible to 
most students. 



Beyond Modern Test Theory 

Postmodernism thus challenges legal thinkers to reconsider their most basic 
understanding of the nature of law and politics — their belief in an objective and 
autonomous law. Postmodems argue that decision making according to rule is 
not possible, because rules are dependent upon language, and language is so- 
cially and culturally constructed and hence incapable of directing decision mak- 
ers to make consistent and objective choices. Objectivity is possible only if 
agreement or consensus about different interpretive practices can be reached. 
(Minda, 1995:245) 

Standards of content and performance are a topic of intense current interest. I 
have argued that limited sets of common assessment tasks, scored and interpreted 
in common ways that ignore context, cannot by their nature tell us all we would 
like to know about students’ learning. They may tell us something worth know- 
ing, especially if the inferences and actions based on them do take context into 
account (Messick, 1989). As noted in the preceding section, technology is broad- 
ening the span and efficiency of such assessment. And with such assessment it is 
possible to gauge the levels of performance of individual students and groups of 
students. The real challenge, it seems, is to extend the notion of standards beyond 
the confines of the modernist perspective: Is it possible to retain the relevance 
and connectedness traditionally associated with informal assessment yet simulta- 
neously serve the communicative and credibility-based functions traditionally 
associated with formal assessment? 

The AP studio art experience suggests that the answer is yes. Learning there 
is individuated, but a shared conception of the nature of intended learning, devel- 
oped through examples and feedback, makes it possible to interpret work in a 
common framework. Such a structure appears necessary if assessments with con- 
structive and individuated data, such as portfolios and exhibitions (e.g., Wiggins, 
1989), are to span time and distance. 

Common meaning is necessary for credibility, but it is not sufficient. Why 
should anyone trust an interpreted evaluation of a performance from a distant 
time and place? Standardized test results gain a measure of credibility from their 
prescribed procedures; these are established “rules of the game,” which, if fol- 
lowed, circumscribe the interpretation of the results. Even though the results 
don’t tell about everything that is important, parents and boards of education can 
ask questions and verify procedures in order to spot invalidating practices. But 
the more individuated an assessment is, the more difficult it becomes to establish 
credibility. 

For example, in some ways teachers are in the best position to evaluate 
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students’ work, by virtue of their knowledge about context and situation. Their 
contextualized evaluations are unquestionably basic for guiding classroom learn- 
ing. Can their evaluations be used for high-stakes purposes beyond the class- 
room, in light of their vested interest in their students’ success and the typically 
wide variation in their interpretations of performance? As noted above, a com- 
mon framework for interpretation is required first. The validity of mappings of 
performances into that framework can be addressed by mechanisms such as au- 
dits, cross evaluation across schools, and triangulation of types of evidence 
(Resnick, 1 994). Technology can play an enabling role, through replayability, 
mass storage, and electronic communication. Statistical modeling can play a 
quality assurance role, through the analysis of ratings of multiply-scored work, as 
discussed above in connection with AP studio art. 

An Example: Adult Literacy Assessment 

As defined by the National Literacy Act of 1991, literacy involves “an 
individual s ability to read, write, and speak in English, compute, and solve 
problems at levels of proficiency necessary to function on the job and in society, 
to achieve one’s goals, and to develop one’s knowledge and potential.’’ The act 
requires state education agencies to “gather and analyze data — including stan- 
dardized test data — on the effectiveness of State-administered adult education 
programs, services, and activities, to determine the extent to which the State’s 
adult education programs are achieving the goals in the state plan’’ [to enhance 
levels of adult literacy and improve the quality of adult education services] {Fed- 
eral Register, 1992). These federal evaluation requirements have prompted inter- 
est in identifying standardized tests and methodologies that are appropriate for 
assessing the effectiveness of adult education programs and for determining the 
feasibility of linking such tests in order to provide national trend data on program 
effectiveness (Pelavin Associates, 1994). 

But the diversity of both the objectives and the participants served by adult 
education programs reflects a broad and multidimensional definition of literacy. 
Accordingly, adult education programs vary considerably with respect to the 
nature and level of skills they emphasize and with respect to the kinds of students 
with whom they work. Some strongly resemble and largely replace the academic 
reading experience that high schools supply, in order to help dropouts obtain 
General Education Development certificates. Others help immigrants and others 
who are literate in languages other than English to speak, read, and write in 
English. Still others work with adults who are literate, if not skilled, from the 
perspective of traditional schooling, in order to develop more specific skills for 
use in the workplace. Moreover, these diverse programs use tests for a broad 
variety of diagnostic, instructional, and evaluative purposes. Both the nature of 
the instruction and the purpose of testing determine the kinds of tests that will be 
appropriate. 
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Is it possible to link results from these varied tests, across the diverse pro- 
grams, to secure a common metric for evaluating program effects and tracking 
trends over time? Writing on the prospect of calibrating disparate tests to com- 
mon national standards, Andrew Porter (1991:35) wrote. 

If this practice of separate assessments continues, can the results be somehow 
equated so that results on one can also be stated in terms of results on the other? 
There are those who place great faith in the ability of statisticians to equate 
tests, but that faith is largely unjustified. Equating can be done only when tests 
measure the same thing. 

Professor Porter’s skepticism is justified. We are perhaps too familiar with 
correspondence tables that give exchangeable scores for alternate forms of stan- 
dardized tests. But they work only because the alternate forms were constructed 
to meet the same tight specifications; equating studies and statistical formulas 
merely put into usable form the evidentiary relationships that were built into 
the tests (see Linn, 1993, and Mislevy, 1993, for definitions, concepts, and 
approaches that have been developed to link educational tests for various 
purposes). 

Statistical procedures neither create nor determine relationships among test 
scores. Rather, the way that tests are constructed and administered and the ways 
that the skills they tap relate to the people to whom they are administered deter- 
mine the nature of the potential relationships that exist in evidence that scores 
from the various tests convey. Much progress has been made recently with 
statistical machinery for this purpose, with power beyond the expectations of 
educational measurement researchers a generation or two ago. However, we now 
recognize the objective of building once-and-for-all correspondence tables as a 
chimera — it is not simply because we lack the tools to answer the question but 
because the question itself is vacuous. Statistical procedures, properly employed, 
can be used to explicate the relationships that do exist in various times and places 
and harness the information they do convey for various purposes. Perhaps more 
importantly, they help us understand what information different tests do not, 
indeed cannot, convey for those purposes. 

Thus, the first two conclusions listed below, about what can be expected from 
applying statistical linking procedures to adult literacy tests, are negative. They 
repudiate a naive modernist goal of rectifying various indicators of a common 
true variable, when those indicators have evolved to serve different purposes in 
different contexts, gathering qualitatively different kinds of information. 

• No single score can give a full picture of the range of skills that are 
important to all the different students in different adult literacy programs. 

• No statistical machinery can translate the results of any two arbitrarily 
selected adult literacy tests so that they provide interchangeable information 
about all relevant questions about student competencies and program effective- 
ness. 
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What is possible? Three less ambitious, but more realistic, affirmative con- 
tingencies, each employing modernist statistical techniques from a neopragmatic 
postmodernist perspective. All require the prerequisite realization that no test 
scores can capture the full range of evidence about students’ developing pro- 
ficiencies within their courses, nor can they convey all that is needed to determine 
how well students are progressing toward their own objectives. This understood, 
here are some options for dealing with such information as there is in literacy test 
scores, when different literacy programs must use different tests in accordance 
with their differing goals and instruction: 

0 Comparing directly the levels of performance across literacy programs in 
terms of common indicators of performance on a market basket of consensually 
defined tasks in standard conditions. Some aspects of competence, and assess- 
ment contexts for gathering evidence about them, will be considered useful by a 
wide range of programs, and components of an assessment system can solicit 
information about them in much the same way for all. However, these “univer- 
sal” assessments — and in particular pre-post comparisons with such assess- 
ments provide seriously incomplete information to evaluate the effectiveness of 
programs, to the extent that their focus does not match the programs’ objectives 
(to say nothing of the students' objectives!). 

° Estimating levels of performance of groups or individuals within clusters 
of literacy programs with similar objectives — possibly in quite different ways in 
different clusters — at the levels of accuracy demanded by purposes within clus- 
ters, with shared assessments focused on those objectives. These components of 
programs’ assessments might gather evidence for different purposes, types of 
students, or levels of proficiency, to complement information gathered by “uni- 
versal” components. 

° Making projections about how students from one program might have 
performed on the assessment of another. When students can be administered 
portions of different clusters’ assessments under conditions similar to those in 
which they are used operationally, the joint distribution of results on those assess- 
ments can be estimated. These studies are restricted as to time, place, program, 
and population, however. The more the assessments differ as to their form, con- 
tent, and context, the more uncertainty is associated with the projections, the 
more they can be expected to vary with students’ background and educational 
characteristics, the more they can shift over time, and the more comparisons of 
program effects become untrustworthy. 

CONCLUSION 

It is a critical time for jurisprudential studies in America. It is a time for self- 
reflection and reevaluation of methodological and theoretical legacies in the 
law. At stake is not only the status of modem jurisprudence, but also the 
validity of the Rule of Law itself. In the current era of academic diversity and 
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disagreement, the time has come to seriously consider the transformative chang- 
es now unfolding in American legal thought. The challenge for the next centu- 
ry will certainly involve new ways of understanding how the legal system can 
preserve the authority of the Rule of Law while responding to the different 
perspectives and interests of multicultural communities. It is without a doubt 
an anxious and exciting time for jurisprudence. . . . 

What was once understood as the mainstream of modern view has broken into a 
diverse body of jurisprudential theories and perspectives. ... No matter how 
troubling it may be, the landscape of the postmodern now surrounds us. It simul- 
taneously delimits us and opens our horizons. It’s our problem and our hope. 
(Minda, 1995:256-257) 

Ironist critics of educational assessment reject the modernist notion that the 
“truth” about a student’s understanding or a program’s effect lies but a simple step 
away from our ken, to be spanned by observations with standard, context-free 
measuring instruments and unambiguous statistical analysis of the results. But to 
further reject any use of these models and information-gathering tools just because 
they arose under the discarded epistemology is to forgo decades of experience 
about some ways to structure and communicate observations about students’ learn- 
ing. Educators fear that wholesale abandonment of familiar assessment methodol- 
ogy strips away tools that help them address these facets of their task. Believing 
these ways of structuring discourse hold no value is as wrong as believing that they 
alone hold value. I hear parents and teachers say that we “should not throw the 
baby out with the bath water.” But how to tell which is which? 

My answer (a neopragmatic postmodernist answer, as it turns out) is this: 
Models, principles, and conceptual frameworks are practicable tools — not for 
discovering a singular truth but for structuring our discourse about students, so 
that we may better support their learning, and for learning about expected and 
unexpected outcomes of our efforts, so that we may continually improve them. 
Understandings of students’ learning and programs’ effects are enriched by mul- 
tiple perspectives and diverse sources of evidence, some new or previously ne- 
glected but others with familiar (albeit reconceived) forms. Postmodern archi- 
tects play with ironies in design, advancing alternative sensibilities and forgotten 
voices — but they had better design buildings that are livable and safe. Funda- 
mental constraints and fundamental responsibilities persist. And as long as we in 
education purport to help other people’s children learn, at other people’s expense, 
we bear the duty of gaining and using as broad an understanding as we can to 
guide our actions and of conveying our reasoning and results as clearly as we can 
to those to whom we are responsible. 
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INTRODUCTION 

The School-to-Work Opportunities Act(20U.S.C.A. §6101 etseq. West Supp, 
1995), creates a framework for cooperation among federal, state, and local gov- 
ernments and agencies, educational institutions, students, labor unions, employ- 
ers, and other organizations committed to economic and community develop- 
ment in order to raise educational standards. The act is broad in scope and is 
designed to provide meaningful benefits to all parties involved. 

At one level, the impetus for congressional action was the growing fear that 
the United States was falling further behind in the global marketplace at least in 
part because of a failure to properly educate its students: congressional findings 
included in the act stress the need for the development of a “comprehensive and 
coherent system” of education that would enable the nation to meet the challenge 
of increasing global competition and technological advances that seem to in- 
crease exponentially. 1 

At a less global level, state and local governments, educational and civic 
organizations, employers, and labor organizations would benefit by receiving the 
advantages of better-trained and more productive workers (20 U.S.C.A., §6102 
(3), (5)). 2 The primary beneficiaries under the act, of course, are students who 

! The congressional findings noted, with some concern, that 3,400,000 individuals in the 
United States have entered the work force who have not completed high school, are not 
enrolled in school, and are particularly unprepared to meet the specialized technical demands 
of the work force of the twenty-first century (20 U.S.C.A. §6101 (l)-(9)). 

2 Moreover, the act would provide seed funding for underwriting the initial costs of planning 
School-to-Work Opportunities systems to be maintained with other federal, state, and local 
resources (20 U.S.C.A. §6102 (4)). 
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would be offered the opportunity “to participate in a performance-based educa- 
tion and training program that will . . . (i) enable [them] to earn portable creden- 
tials; (ii) prepare [them] for first jobs in high-skill, high-wage careers; and (iii) 
increase their opportunities for further education, including education in a 4-year 
college or university” (20 U.S.C.A. §6102 (1)). 

The act’s intended consequences for the future of American students go be- 
yond preparing them for entry-level positions or facilitating postsecondary edu- 
cation. Congress clearly intended long-term results to facilitate opportunity for 
students throughout their working lives: 

The purposes of this Chapter are to facilitate the creation of a universal, high quality 
school-to-work transition system that enables youths in the United States to iden- 
tify and navigate paths to productive and progressively more rewarding roles in the 
workplace. . . . (20 U.S.C.A. §6102 (2)) 

For purposes of this paper, the most significant aspect of the breadth of the 
act’s scope is that it envisions having an impact on students who have thus far not 
been reached by existing job training or education reform legislation; it would do 
this by providing the means for including in its proposed vision people who had 
historically been excluded from educational and economic opportunities. This 
would be done by reaching out to school dropouts and low-achieving and dis- 
abled youths (those who have traditionally been prime candidates for dropping 
out). The act also seeks to include those whose lack of access to equal employ- 
ment opportunity is due to discrimination in employment: “The purposes of this 
chapter are ... to increase opportunities for minorities, women, and individuals 
with disabilities, by enabling individuals to prepare for careers that are not tradi- 
tional for their race, gender, or disability (20 U.S.C.A. §6102 (13)). 

Given the broad scope of the act’s goals and its mandate to those seeking to 
participate in the program it establishes, the success of the act will be judged in 
large part by the degree to which the work force of the twenty-first century more 
closely resembles the nation’s population. Because the focus of the act is on 
changing the content of American education and facilitating the transition from 
schoolyard to workplace, assessment of student performance will assume even 
greater importance. Although academic success has always had an impact on 
later opportunities in life, the greater link between schools and the working world 
that the act seeks to accomplish raises the stakes for all involved. Given the 
potential impact of programs spawned by the act, it is particularly important that 
very careful consideration be given to the way that programs are implemented. 

Implicit in the discussion of raised educational standards and increased em- 
ployment opportunities are questions about the methods by which students will 
be evaluated and the effects that this evaluation process will have on determining 
which students receive the opportunities envisioned in the act. Also implicit is 
the issue of who will be responsible for shaping the curriculum that students 
receive. The legislation is significant in that it redefines to some extent the role 
of schools and the educational structure that supports them in determining what it 
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means to be educated. Whereas before the act, to use a commercial analogy that 
may be particularly appropriate under the circumstances, if it were asked who the 
primary “customer” for educational services is, the most common answer would 
undoubtedly have been “students.” This is not to say that there was no concern 
for the ability of graduates to find meaningful employment. An unemployable 
graduate would certainly not be a satisfied customer. But the primary focus was 
the development of a well-rounded individual prepared for all aspects of life . 3 

The act, in essence, broadens the concept of “customer.” By involving busi- 
ness more directly at the front end, the act essentially acknowledges that it, too, is 
a “customer” with an interest in the “product” of a graduate who is adequately 
prepared to meet the employment needs of businesses. 

This paper will not address questions of the appropriateness of business in- 
volvement in the setting of educational agendas. However, it is important to 
recognize that one of the challenges presented by implementation of the School- 
to-Work Opportunities Act will arise from the fact that there is not a complete 
congruence of interests among all members of the educational partnership that 
the act creates. 

The potential difference in interests, particularly between businesses and 
schools, will require extreme vigilance in order to assure that the program is imple- 
mented in an equitable manner. For the most part, the primary burden of this 
vigilance will and must fall on the schools, in large part because providing a com- 
prehensive education is their ultimate responsibility but also because the schools 
would presumably not be driven by profit to the same degree as businesses. 

Although educational institutions and schools may have somewhat different 
interests, both must consider the equity concerns raised by programs in which 
they are joint partners. It is essential that each partner recognize that each compo- 
nent part of a new program has a potential impact on the question of equal oppor- 
tunity. This paper will focus on those components that relate to the question of 
assessment and credentialing. 



3 For example, in Rose v. Council for Better Education, Inc. (790 S.W. 2d 186, 212 (Ky.- 
1989)), the Supreme Court defined guidelines for determining if the slate had fulfilled its consti- 
tutional obligation to provide an adequate education, stating that an educated child must possess 
at least the seven following capabilities: (i) sufficient oral and written communication skills to 
enable students to function in a complex and rapidly changing civilization; (ii) sufficient knowl- 
edge of economic, social, and political systems to enable students to make informed choices; (iii) 
sufficient understanding of governmental processes to enable the student to understand the issues 
that affect his or her community, state and nation; (iv) sufficient self-knowledge and knowledge 
of his or her mental and physical wellness; (v) sufficient grounding in the arts to enable each 
student to appreciate his or her cultural and historical heritage; (vi) sufficient training or prepara- 
tion for advanced training in either academic or vocational fields so as to enable each child to 
choose and pursue life work intelligently; and (vii) sufficient level of academic or vocational 
skills to enable public schools to compete favorably with their counterparts in surrounding states, 
in academics or in the job market.” Although the first and last capabilities include concerns about 
job readiness, the list of criteria is far more comprehensive. 
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